U C^. @sddlmZddlmZmZmZmZddlmZmZm Z m Z m Z dZ e ddZedZd geeeeZeeeed d d je d dje ddjede e dgZeedjddddjeddjee dddjee ddjedgZeZeZeZdS) )unicode_literals) LIST_PUNCT LIST_ELLIPSES LIST_QUOTES LIST_ICONS) ALPHA_LOWERALPHAHYPHENS CONCAT_QUOTESUNITSu\$¢£€¥฿৳'u। ॥z\+z (?<=[0-9])\+u(?<=°[FfCcKk])\.z(?<=[0-9])(?:[{c}]))cz(?<=[0-9])(?:{u}))uz(?<=[{al}{e}{q}(?:{c})])\.u%²\-\+)aleqrz7(?<=[0-9{zero}-{nine}])[+\-\*^=](?=[0-9{zero}-{nine}-])u০u৯)ZzeroZninez(?<=[{a}]),(?=[{a}]))az(?<=[{a}])({h})(?=[{ae}])uএ)rhZaez(?<=[{a}])(?:{h})(?=[{a}]))rrz(?<=[{a}])[:<>=/](?=[{a}])N) __future__rZ char_classesrrrrrr r r r Z _currencyreplaceZ_quotesstripsplitZ _list_punct _prefixesformatZ _suffixesZ_infixesZTOKENIZER_PREFIXESZTOKENIZER_SUFFIXESZTOKENIZER_INFIXESrrsV