fH^c@sdZddlZddlZddlZddlmZddlmZddl m Z ddl m Z m Z mZmZddlmZdd lmZdd lmZdd lmZdd lmZmZmZdd lmZmZmZm Z m!Z!m"Z"m#Z#ddl$m%Z%m&Z&ddl'm(Z(m)Z)m*Z*m+Z+m,Z,m-Z-m.Z.m/Z/m0Z0m1Z1ddl2m3Z3m4Z4m5Z5m6Z6m7Z7m8Z8m9Z9m:Z:m;Z;m<Z<m=Z=m>Z>ddl2m?Z@ddlAmBZBeBjCeBjDeBjEeBjFeBjGfZHdZIddZJdZKdeLfdYZMdeLfdYZNdeNfdYZOdeMeNfdYZPdeLfd YZQdS(!s` requests.models ~~~~~~~~~~~~~~~ This module contains the primary objects that power Requests. iN(t RequestField(tencode_multipart_formdata(t parse_url(t DecodeErrortReadTimeoutErrort ProtocolErrortLocationParseError(tUnsupportedOperationi(t default_hooks(tCaseInsensitiveDict(t HTTPBasicAuth(tcookiejar_from_dicttget_cookie_headert_copy_cookie_jar(t HTTPErrort MissingSchemat InvalidURLtChunkedEncodingErrortContentDecodingErrortConnectionErrortStreamConsumedError(tto_native_stringtunicode_is_ascii( tguess_filenametget_auth_from_urlt requote_uritstream_decode_response_unicodetto_key_val_listtparse_header_linkst iter_slicestguess_json_utft super_lentcheck_header_validity( tCallabletMappingt cookielibt urlunparseturlsplitt urlencodetstrtbytestis_py2tchardett builtin_strt basestring(tjson(tcodesii iitRequestEncodingMixincBs5eZedZedZedZRS(cCssg}t|j}|j}|s-d}n|j||j}|rf|jd|j|ndj|S(sBuild the path URL to use.t/t?t(R%turltpathtappendtquerytjoin(tselfR3tpR4R6((srequests/models.pytpath_url=s     cCst|ttfr|St|dr,|St|drg}xt|D]\}}t|tsyt|d r|g}nxl|D]d}|dk r|jt|tr|jdn|t|tr|jdn|fqqWqNWt |dt S|SdS(sEncode parameters in a piece of data. Will successfully encode parameters when passed as a dict or a list of 2-tuples. Order is retained if data is a list of 2-tuples but arbitrary if parameters are supplied as a dict. treadt__iter__sutf-8tdoseqN( t isinstanceR'R(thasattrRR,tNoneR5tencodeR&tTrue(tdatatresulttktvstv((srequests/models.pyt_encode_paramsRs    !3c Cs|stdnt|tr3tdng}t|pEi}t|pWi}x|D]\}}t|tst|d r|g}nx|D]}|d k rt|tst|}n|jt|tr|j dn|t|tr|j dn|fqqWqdWx<|D]4\}}d }d } t|t t frt |dkr|\} } qt |dkr|\} } }q|\} } }} nt|p|} |} t| tttfr| } n6t| dr| j} n| d kr#q3n| } td|d | d | d | } | jd ||j| q3Wt|\}}||fS(sBuild the body for a multipart/form-data request. Will successfully encode files when passed as a dict or a list of tuples. Order is retained if data is a list of tuples but arbitrary if parameters are supplied as a dict. The tuples may be 2-tuples (filename, fileobj), 3-tuples (filename, fileobj, contentype) or 4-tuples (filename, fileobj, contentype, custom_headers). sFiles must be provided.sData must not be a string.R<sutf-8iiR;tnameRCtfilenametheaderst content_typeN(t ValueErrorR>R,RR?R@R(R'R5tdecodeRAttupletlisttlenRt bytearrayR;Rtmake_multipartR(tfilesRCt new_fieldstfieldstfieldtvalRGREtfttfhtfntfptfdatatrftbodyRL((srequests/models.pyt _encode_filesmsP    !3  !(t__name__t __module__tpropertyR:t staticmethodRHR`(((srequests/models.pyR/<stRequestHooksMixincBseZdZdZRS(cCs|||jkr"td|nt|trH|j|j|n0t|drx|j|jd|DndS(sProperly register a hook.s1Unsupported event specified, with event name "%s"R<css$|]}t|tr|VqdS(N(R>R!(t.0th((srequests/models.pys sN(thooksRMR>R!R5R?textend(R8teventthook((srequests/models.pyt register_hooks cCs5y|j|j|tSWntk r0tSXdS(siDeregister a previously registered hook. Returns True if the hook existed, False if not. N(RhtremoveRBRMtFalse(R8RjRk((srequests/models.pytderegister_hooks  (RaRbRlRo(((srequests/models.pyRes tRequestc BsGeZdZddddddddddd ZdZdZRS(s{A user-created :class:`Request ` object. Used to prepare a :class:`PreparedRequest `, which is sent to the server. :param method: HTTP method to use. :param url: URL to send. :param headers: dictionary of headers to send. :param files: dictionary of {filename: fileobject} files to multipart upload. :param data: the body to attach to the request. If a dictionary or list of tuples ``[(key, value)]`` is provided, form-encoding will take place. :param json: json for the body to attach to the request (if files or data is not specified). :param params: URL parameters to append to the URL. If a dictionary or list of tuples ``[(key, value)]`` is provided, form-encoding will take place. :param auth: Auth handler or (user, pass) tuple. :param cookies: dictionary or CookieJar of cookies to attach to this request. :param hooks: dictionary of callback hooks, for internal usage. Usage:: >>> import requests >>> req = requests.Request('GET', 'https://httpbin.org/get') >>> req.prepare() c Cs|dkrgn|}|dkr*gn|}|dkrBin|}|dkrZin|}| dkrrin| } t|_x6t| jD]"\} } |jd| d| qW||_||_||_||_ ||_ | |_ ||_ ||_ ||_dS(NRjRk(R@RRhRPtitemsRltmethodR3RKRTRCR-tparamstauthtcookies( R8RrR3RKRTRCRsRtRuRhR-RERG((srequests/models.pyt__init__s"         cCs d|jS(Ns(Rr(R8((srequests/models.pyt__repr__scCsqt}|jd|jd|jd|jd|jd|jd|jd|jd|j d |j d |j |S( sXConstructs a :class:`PreparedRequest ` for transmission and returns it.RrR3RKRTRCR-RsRtRuRh( tPreparedRequesttprepareRrR3RKRTRCR-RsRtRuRh(R8R9((srequests/models.pyRys            N(RaRbt__doc__R@RvRwRy(((srequests/models.pyRps  Rxc BseZdZdZddddddddddd ZdZdZdZe dZ dZ dZ dd Z d Zd d Zd ZdZRS(sThe fully mutable :class:`PreparedRequest ` object, containing the exact bytes that will be sent to the server. Generated from either a :class:`Request ` object or manually. Usage:: >>> import requests >>> req = requests.Request('GET', 'https://httpbin.org/get') >>> r = req.prepare() >>> s = requests.Session() >>> s.send(r) cCsFd|_d|_d|_d|_d|_t|_d|_dS(N( R@RrR3RKt_cookiesR_RRht_body_position(R8((srequests/models.pyRv"s      c Csk|j||j|||j||j||j||| |j|||j| dS(s6Prepares the entire request with the given parameters.N(tprepare_methodt prepare_urltprepare_headerstprepare_cookiest prepare_bodyt prepare_autht prepare_hooks( R8RrR3RKRTRCRsRtRuRhR-((srequests/models.pyRy3s   cCs d|jS(Ns(Rr(R8((srequests/models.pyRwEscCst}|j|_|j|_|jdk r?|jjnd|_t|j|_|j|_|j |_ |j |_ |S(N( RxRrR3RKR@tcopyR R{R_RhR|(R8R9((srequests/models.pyRHs   '   cCs7||_|jdk r3t|jj|_ndS(sPrepares the given HTTP method.N(RrR@Rtupper(R8Rr((srequests/models.pyR}Ss cCsOddl}y"|j|dtjd}Wn|jk rJtnX|S(Nituts46sutf-8(tidnaRARBRNt IDNAErrort UnicodeError(thostR((srequests/models.pyt_get_idna_encoded_hostYs  " cCst|tr!|jd}ntr3t|n t|}|j}d|krz|jjd rz||_ dSy%t |\}}}}}}} Wn"t k r} t | j nX|sd} | jt|d} t| n|st d|nt|sRy|j|}Wqptk rNt dqpXn|jdrpt dn|pyd } | r| d 7} n| |7} |r| dt|7} n|sd }ntrst|tr|jd }nt| tr | jd } nt|tr.|jd }nt|trO|jd }nt| trs| jd } qsnt|ttfrt|}n|j|} | r|rd || f}q| }ntt|| |d|| g}||_ dS(sPrepares the given HTTP URL.tutf8t:thttpNsDInvalid URL {0!r}: No schema supplied. Perhaps you meant http://{0}?s Invalid URL %r: No host suppliedsURL has an invalid label.u*R2t@R0sutf-8s%s&%s(R>R(RNR)tunicodeR'tlstriptlowert startswithR3RRRtargstformatRRRRRRARHRR$R@(R8R3RstschemeRtRtportR4R6tfragmentteterrortnetloct enc_params((srequests/models.pyR~csh " %       $cCsYt|_|rUx@|jD]/}t||\}}||jt|R(RAtallR?R,RPROR"Rt TypeErrortAttributeErrorRtgetattrRR|tIOErrortOSErrortobjecttNotImplementedErrorR+RKR`RHtprepare_content_lengthR_(R8RCRTR-R_RLt is_streamtlength((srequests/models.pyRsJ "    cCsr|dk r7t|}|rnt||jdPrepare Content-Length header based on request method and bodysContent-LengthtGETtHEADt0N(RR(R@RR+RKRrtget(R8R_R((srequests/models.pyR s   'R2cCs|dkr6t|j}t|r-|nd}n|rt|trlt|dkrlt|}n||}|jj |j|j |j ndS(s"Prepares the given HTTP auth data.iN( R@RR3tanyR>RORQR t__dict__tupdateRR_(R8RtR3turl_authtr((srequests/models.pyRs ! cCs_t|tjr||_nt||_t|j|}|dk r[||jd` object. Any subsequent calls to ``prepare_cookies`` will have no actual effect, unless the "Cookie" header is removed beforehand. tCookieN(R>R#t CookieJarR{R R R@RK(R8Rut cookie_header((srequests/models.pyR,s   cCs5|p g}x"|D]}|j|||qWdS(sPrepares the given hooks.N(Rl(R8RhRj((srequests/models.pyR@s  N(RaRbRzRvR@RyRwRR}RdRR~RRRRRR(((srequests/models.pyRxs    V E  tResponsec Bs7eZdZddddddddd d g Zd Zd Zd ZdZdZdZ dZ dZ dZ e dZe dZe dZe dZe dZdedZeed"dZe dZe dZdZe dZd Zd!ZRS(#shThe :class:`Response ` object, which contains a server's response to an HTTP request. t_contentt status_codeRKR3thistorytencodingtreasonRutelapsedtrequestcCst|_t|_d|_d|_t|_d|_d|_ d|_ g|_ d|_ t i|_tjd|_d|_dS(Ni(RnRt_content_consumedR@t_nextRR RKtrawR3RRRR Rutdatetimet timedeltaRR(R8((srequests/models.pyRvTs          cCs|S(N((R8((srequests/models.pyt __enter__scGs|jdS(N(tclose(R8R((srequests/models.pyt__exit__scs*jsjnfdjDS(Ncs%i|]}t|d|qS(N(RR@(Rftattr(R8(srequests/models.pys s (Rtcontentt __attrs__(R8((R8srequests/models.pyt __getstate__s  cCsQx*|jD]\}}t|||q Wt|dtt|dddS(NRR(RqtsetattrRBR@(R8tstateRIR((srequests/models.pyt __setstate__scCs d|jS(Ns(R(R8((srequests/models.pyRwscCs|jS(skReturns True if :attr:`status_code` is less than 400. This attribute checks if the status code of the response is between 400 and 600 to see if there was a client error or a server error. If the status code, is between 200 and 400, this will return True. This is **not** a check to see if the response code is ``200 OK``. (tok(R8((srequests/models.pyt__bool__scCs|jS(skReturns True if :attr:`status_code` is less than 400. This attribute checks if the status code of the response is between 400 and 600 to see if there was a client error or a server error. If the status code, is between 200 and 400, this will return True. This is **not** a check to see if the response code is ``200 OK``. (R(R8((srequests/models.pyt __nonzero__scCs |jdS(s,Allows you to use a response as an iterator.i(t iter_content(R8((srequests/models.pyR<scCs'y|jWntk r"tSXtS(sxReturns True if :attr:`status_code` is less than 400, False if not. This attribute checks if the status code of the response is between 400 and 600 to see if there was a client error or a server error. If the status code is between 200 and 400, this will return True. This is **not** a check to see if the response code is ``200 OK``. (traise_for_statusRRnRB(R8((srequests/models.pyRs  cCsd|jko|jtkS(sTrue if this Response is a well-formed HTTP redirect that could have been processed automatically (by :meth:`Session.resolve_redirects`). tlocation(RKRtREDIRECT_STATI(R8((srequests/models.pyt is_redirectscCs(d|jko'|jtjtjfkS(s@True if this Response one of the permanent versions of redirect.R(RKRR.tmoved_permanentlytpermanent_redirect(R8((srequests/models.pytis_permanent_redirectscCs|jS(sTReturns a PreparedRequest for the next request in a redirect chain, if there is one.(R(R8((srequests/models.pytnextscCstj|jdS(s7The apparent encoding, provided by the chardet library.R(R*tdetectR(R8((srequests/models.pytapparent_encodingsicsfd}jr9tjtr9tn5dk rntt rntdtnt j}|}jr|n|}|rt |}n|S(sIterates over the response data. When stream=True is set on the request, this avoids reading the content at once into memory for large responses. The chunk size is the number of bytes it should read into memory. This is not necessarily the length of each item returned as decoding can take place. chunk_size must be of type int or None. A value of None will function differently depending on the value of `stream`. stream=True will read data as it arrives in whatever size the chunks are received. If stream=False, data is returned as a single chunk. If decode_unicode is True, content will be decoded using the best available encoding based on the response. c3stjdry,x%jjdtD] }|Vq.WWqtk r_}t|qtk r}}t|qtk r}t |qXn.x+trjj }|sPn|VqWt_ dS(Ntstreamtdecode_content( R?RRRBRRRRRRR;R(tchunkR(t chunk_sizeR8(srequests/models.pytgenerates    s.chunk_size must be an int, it is instead a %s.N( RR>RtboolRR@tintRttypeRR(R8Rtdecode_unicodeRt reused_chunkst stream_chunkstchunks((RR8srequests/models.pyRs  ccsd}x|jd|d|D]}|dk r>||}n|rV|j|}n |j}|r|dr|r|dd|dkr|j}nd}x|D] }|VqWqW|dk r|VndS(sIterates over the response data, one line at a time. When stream=True is set on the request, this avoids reading the content at once into memory for large responses. .. note:: This method is not reentrant safe. RRiN(R@Rtsplitt splitlinestpop(R8RRt delimitertpendingRtlinestline((srequests/models.pyt iter_liness   .   cCs|jtkru|jr'tdn|jdksE|jdkrQd|_qudj|jt pld|_nt |_|jS(s"Content of the response, in bytes.s2The content for this response was already consumediR2N( RRnRt RuntimeErrorRRR@R7RtCONTENT_CHUNK_SIZERB(R8((srequests/models.pyR/s   $ cCsd}|j}|js"tdS|jdkr=|j}nyt|j|dd}Wn,ttfk rt|jdd}nX|S(sContent of the response, in unicode. If Response.encoding is None, encoding will be guessed using ``chardet``. The encoding of the response content is determined based solely on HTTP headers, following RFC 2616 to the letter. If you can take advantage of non-HTTP knowledge to make a better guess at the encoding, you should set ``r.encoding`` appropriately before accessing this property. R2terrorstreplaceN(R@RRR'Rt LookupErrorR(R8RR((srequests/models.pyttextCs    cKs|j r}|jr}t|jdkr}t|j}|dk r}y tj|jj||SWqztk rvqzXq}ntj|j |S(sReturns the json-encoded content of a response, if any. :param \*\*kwargs: Optional arguments that ``json.loads`` takes. :raises ValueError: If the response body does not contain valid json. iN( RRRQRR@RtloadsRNtUnicodeDecodeErrorR(R8tkwargsR((srequests/models.pyR-is(   cCsj|jjd}i}|rft|}x9|D].}|jdpR|jd}|||RR(RNRRR3R(R8thttp_error_msgR((srequests/models.pyRs  cCsH|js|jjnt|jdd}|dk rD|ndS(sReleases the connection back to the pool. Once this method has been called the underlying ``raw`` object must not be accessed again. *Note: Should not normally need to be called explicitly.* t release_connN(RRRRR@(R8R((srequests/models.pyRs   N(RaRbRzRRvRRRRRwRRR<RcRRRRRRnRtITER_CHUNK_SIZER@RRRR-RRR(((srequests/models.pyRJs2 /      7&  (RRzRtsystencodings.idnat encodingsturllib3.fieldsRturllib3.filepostRt urllib3.utilRturllib3.exceptionsRRRRtioRRhRt structuresR RtR RuR R R t exceptionsRRRRRRRt_internal_utilsRRtutilsRRRRRRRRRR tcompatR!R"R#R$R%R&R'R(R)R*R+R,R-Rt status_codesR.tmovedtfoundtotherttemporary_redirectRRtDEFAULT_REDIRECT_LIMITRRRR/ReRpRxR(((srequests/models.pyts@   "4FR  rJ;