ó <¿CVc@@s¶dZddlmZmZddlZddlZddlmZddlm Z dd„Z dd d ddd gZddddgZd„Z ddZd„Zdd„ZdS(uu The following test performs a random series of reads, seeks, and tells, and checks that the results are consistent. i(tabsolute_importtunicode_literalsN(tBytesIO(tSeekableUnicodeStreamReaderiècC@sˆ|j|ƒ}t|ƒ}t|ƒ}t||ƒ}g}xJtrˆ|jƒ}|j||jdƒfƒ|dddkr?Pq?q?Wtd„|Dƒƒ} xJ|D]B\} }x3|D]+\}} || kr¹| |c|7sutsrrutusurg333333Ó?gš™™™™™É?gš™™™™™é?iiiupassed(tencodetlenRRtTruettelltappendtreadtdicttrandomtchoicetseektNonetrandinttinttreadlinetAssertionErrort startswith(tunicode_stringtencodingtntbytestrtstrlentstreamtreadertcharsRtstringstpos1tchartpos2t_toptpRtnew_postsizets((s„/private/var/folders/cc/xm4nqn811x9b50x1q_zpkmvdjlphkp/T/pip-build-FUwmDn/nltk/nltk/test/unit/test_seekable_unicode_stream_reader.pytcheck_readersP ( uasciiulatin1ugreekuhebrewuutf-16uutf-8u6 This is a test file. It is fairly short. u(This file can be encoded with latin1. Âƒu^ This is a test file. Here's a blank line: And here's some unicode: Ã® Ä£ ï¿£ uG This is a test file. Unicode characters: Ã³ âˆ¢ ãŒ³ä‘„ å•• cc@sYxRtD]J}xAtD]9}y|j|ƒt||fVWqtk rLqXqWqWdS(N(tSTRINGSt ENCODINGSRR)tUnicodeEncodeError(tstringR((s„/private/var/folders/cc/xm4nqn811x9b50x1q_zpkmvdjlphkp/T/pip-build-FUwmDn/nltk/nltk/test/unit/test_seekable_unicode_stream_reader.pyttest_readerVs uÃThis is a larger file. It has some lines that are longer than 72 characters. It's got lots of repetition. Here's some unicode chars: Ã® Ä£ ï¿£ î»® â… How fun! Let's repeat it twenty times. i cc@sQxJtD]B}y(tj|ƒdd„}||fVWqtk rHqXqWdS(NiècS@stt||ƒdS(N(R)tLARGE_STRING(RR((s„/private/var/folders/cc/xm4nqn811x9b50x1q_zpkmvdjlphkp/T/pip-build-FUwmDn/nltk/nltk/test/unit/test_seekable_unicode_stream_reader.pyt_checkrs(R+R/RR,(RR0((s„/private/var/folders/cc/xm4nqn811x9b50x1q_zpkmvdjlphkp/T/pip-build-FUwmDn/nltk/nltk/test/unit/test_seekable_unicode_stream_reader.pyttest_reader_on_large_stringms cC@sddl}|jƒdS(Ni(tgctcollect(tmoduleR2((s„/private/var/folders/cc/xm4nqn811x9b50x1q_zpkmvdjlphkp/T/pip-build-FUwmDn/nltk/nltk/test/unit/test_seekable_unicode_stream_reader.pytteardown_modulezs(t__doc__t __future__RRRt functoolstioRtnltk.corpus.readerRR)R+R*R.R/R1RR5(((s„/private/var/folders/cc/xm4nqn811x9b50x1q_zpkmvdjlphkp/T/pip-build-FUwmDn/nltk/nltk/test/unit/test_seekable_unicode_stream_reader.pyts2