U C^`@sddlmZddlmZmZddlmZddlmZddl m Z dd l m Z dd l mZdd lmZGd d d ejZGdddeZdgZdS))unicode_literals)LANGNORM) BASE_NORMS)Language)Doc) STOP_WORDS) add_lookups) LEX_ATTRSc@sLeZdZeejjZddee<eejje e ee <e e e ZdZdS)VietnameseDefaultscCsdS)Nvi)textrr9/tmp/pip-install-6_kvzl1k/spacy/spacy/lang/vi/__init__.pyzVietnameseDefaults.TN)__name__ __module__ __qualname__dictrDefaultsZlex_attr_gettersrr rrupdater r stop_wordsuse_pyvirrrrr s    rc@seZdZdZeZddZdS) VietnamesercCs|jjrXzddlm}Wn tk r8d}t|YnX||\}}t|j||dSg}g}||D]8}| t |j | dgt |j t |j|d<qjt|j||dSdS)Nr) ViTokenizerzkPyvi not installed. Either set Vietnamese.use_pyvi = False, or install it https://pypi.python.org/pypi/pyvi)wordsspacesF)rrZpyvir ImportErrorZspacy_tokenizer Zvocab tokenizerextendlistrlenboolZ whitespace_)selfrrmsgrr tokenrrrmake_docs zVietnamese.make_docN)rrrlangrrr+rrrrrsrN) __future__rattrsrrZnorm_exceptionsrlanguagertokensr rr utilr Z lex_attrsr rrr__all__rrrrs