o ;ήcm@s<ddlZddlZddlZddlZddlZddlZddlZddlZddlm Z m Z m Z ddl m Z mZmZddlmZmZddlmZmZmZmZmZmZmZmZmZmZmZddlZddl m!Z!m"Z"m#Z#m$Z$ddl%m&Z&dd l'm(Z(m)Z)m*Z*m+Z+m,Z,dd l-m.Z.dd l/m0Z0m1Z1m2Z2m3Z3m4Z4m5Z5dd l6m7Z7dd l)m8Z8m9Z9m:Z:m;Z;mZ>m?Z?ddl*m@Z@mAZAmBZBmCZCddlDmEZEddlFmGZGddlHmIZImJZJmKZKmLZLmMZMz ddlNZNddlNmOZOWn ePydZNeQZOYnwzddlRZSWn ePyddlTZSYnwdZUerddlVmWZWddlXmYZYddlZm[Z[e\dZ]ej^ddddGdddZ_ej^ddddGdddZ`GdddZaeNdurNeNjOebeaecdfZdnecdZdd ed!ebeadfd"eebd#ed!d$eeed%ed!ebeadff d&d'Zfej^dddd(Gd)d*d*Zgd+ehd,ehd%ebfd-d.ZiGd/d0d0ZjGd1d2d2e;ZkdS)3N)md5sha1sha256) CookieErrorMorsel SimpleCookie)MappingProxyType TracebackType) TYPE_CHECKINGAnyDictIterableListMappingOptionalTupleTypeUnioncast) CIMultiDictCIMultiDictProxy MultiDictMultiDictProxy)URL)hdrshelpershttp multipartpayload)AbstractStreamWriter)ClientConnectionError ClientOSErrorClientResponseErrorContentTypeError InvalidURLServerFingerprintMismatch)FormData)PY_36BaseTimerContext BasicAuth HeadersMixin TimerNoopnoopreify set_result)SERVER_SOFTWARE HttpVersion10 HttpVersion11 StreamWriter) client_logger) StreamReader)DEFAULT_JSON_DECODER JSONDecoder LooseCookies LooseHeaders RawHeaders) SSLContext) ClientRequestClientResponse RequestInfo Fingerprint) ClientSession) Connection)Tracez!^application/(?:[\w.+-]+?\+)?jsonT) auto_attribsfrozenslotsc@s.eZdZUeeed<ded<eeed<dS)ContentDispositiontypezMappingProxyType[str, str] parametersfilenameN)__name__ __module__ __qualname__rstr__annotations__rOrOurlmethodCIMultiDictProxy[str]headersreal_urlreturncC|jSN)rQselfrOrOrPreal_url_defaultezRequestInfo.real_url_defaultN) rJrKrLrrNrMattribrUdefaultr[rOrOrOrPr>^s r>c@sPeZdZeeedZdeddfddZe defddZ d e j ddfd d Z dS) r?) fingerprintrVNcCsHt|}|j|}|std|tus|turtd||_||_dS)Nzfingerprint has invalid lengthz8md5 and sha1 are insecure and not supported. Use sha256.)lenHASHFUNC_BY_DIGESTLENget ValueErrorrr _hashfunc _fingerprint)rZrc digestlenhashfuncrOrOrP__init__qs  zFingerprint.__init__cCrWrX)rirYrOrOrPrc}r\zFingerprint.fingerprint transportcCs`|dsdS|d}|jdd}||}||jkr.|d^}}}t|j|||dS)N sslcontext ssl_objectT) binary_formpeername)get_extra_info getpeercertrhdigestrir&)rZrmsslobjcertgothostport_rOrOrPchecks    zFingerprint.check)rJrKrLrrrrebytesrlpropertyrcasyncio Transportr{rOrOrOrPr?js r?sslr; verify_ssl ssl_contextrcrVcCs|dur|stjdtdd|durtdd}|dur.tjdtdd|dur,td|}|durFtjdtdd|durBtdt|}t|tsRtd||S) Nz/verify_ssl is deprecated, use ssl=False instead stacklevelzNverify_ssl, ssl_context, fingerprint and ssl parameters are mutually exclusiveFz2ssl_context is deprecated, use ssl=context insteadzCfingerprint is deprecated, use ssl=Fingerprint(fingerprint) insteadzFssl should be SSLContext, bool, Fingerprint or None, got {!r} instead.) warningswarnDeprecationWarningrgr? isinstanceSSL_ALLOWED_TYPES TypeErrorformat)rrrrcrOrOrP_merge_ssl_paramssN  r)rCrErDc@sbeZdZUeed<eeed<eed<ee dee fed<ee ed<ee ed<eeed<dS) ConnectionKeyrxryis_sslNrproxy proxy_authproxy_headers_hash) rJrKrLrMrNrintboolrr;r?rr*rOrOrOrPrs    rresponse_content_typeexpected_content_typecCs|dkr t|duS||vS)Napplication/json)json_rematch)rrrOrOrP_is_expected_content_typesrc-@s,eZdZejejejejhZej ej ej hZ e e  ejhZejdejdiZdZdZdZdZdZddedddejddddddddddddddeded eeeefd eed e ed e!d ee"dee#dej$deedee%de%dee&j'dee(ddeedee#dee)dedde*e+e%e,dfdeedee-df*dd Z.d!e%fd"d#Z/e0d!e*d$de%e,ffd%d&Z1e0d!e2fd'd(Z3e0d!efd)d*Z4e0d!ee5fd+d,Z6e0d!e7fd-d.Z8ded!dfd/d0Z9de*ej$efd!dfd1d2Z:d eed!dfd3d4Z;d e ed!dfd5d6ZdZd;d<Z?dee#d!dfd=d>Z@d?e!d!dfd@dAZAd[dBe%d!dfdCdDZBdeedee#deed!dfdEdFZCd!e%fdGdHZDdIeEdJdKd!dfdLdMZFd\dNdOZGdZdPdQZHdZdRdSZIdededTeJd!dfdUdVZKdeded dWd!dfdXdYZLdS)]r<z*/*z gzip, deflateNF)paramsrTskip_auto_headersdatacookiesauthversioncompresschunked expect100loopresponse_classrrtimersessionr proxy_headerstracesrRrQrrTrrrrrrrrrrr=rrrrr@rrrrBcCs| durt} t|tsJ|t|ttdfsJ|td||_|r;t|j}| |}| |j| |}||_ | d|_ ||_| |_| |_| |_d|_|dur\t}n|}||_|durg|nt|_||_| r{ttd|_|| | ||!||"||#||$||%||&||||'||dus|j|j(vr|)|*| |durg}||_+dS)Nr@r),r~get_event_looprrrGr_sessionrquery with_queryextend original_url with_fragmentrQupperrRrrrlengthr=rr,_timer_ssl get_debug traceback extract_stacksys _getframe_source_tracebackupdate_version update_hostupdate_headersupdate_auto_headersupdate_cookiesupdate_content_encoding update_auth update_proxyupdate_body_from_data GET_METHODSupdate_transfer_encodingupdate_expect_continue_traces)rZrRrQrrTrrrrrrrrrrrrrrrrrqurl2real_response_classrOrOrPrlsP                 zClientRequest.__init__rVcCs |jjdvS)N)httpswss)rQschemerYrOrOrPrAs zClientRequest.is_sslr;cCrWrX)rrYrOrOrPrDr\zClientRequest.sslcCsL|j}|rttdd|D}nd}t|j|j||j|j |j |S)Ncss|] \}}||fVqdSrXrO).0kvrOrOrP Lsz/ClientRequest.connection_key..) rhashtupleitemsrrxryrrrr)rZrhrOrOrPconnection_keyHszClientRequest.connection_keycCs|jj}|dus J|SrX)rQraw_host)rZretrOrOrPrxYs zClientRequest.hostcCs|jjSrX)rQryrYrOrOrPry_szClientRequest.portcCst|j}t|j|j||jSrX)rrTr>rQrRr)rZrTrOrOrP request_infocs zClientRequest.request_infocCs:|jst||j|j}}|rt||pd|_dSdS)z8Update destination host, port and connection type (ssl).N)rr%userpasswordrr*r)rZrQusernamerrOrOrPrhs zClientRequest.update_hostcCsjt|tr0dd|ddD}ztt|dt|d}Wnty/td|dw||_dS)zdConvert request version to two elements tuple. parser HTTP version '1.1' => (1, 1) cSsg|]}|qSrO)strip)rpartrOrOrP ysz0ClientRequest.update_version...rrz#Can not parse http version number: N)rrMsplitr HttpVersionrrgr)rZrrrOrOrPrss    zClientRequest.update_versioncCst|_tt|jj}t|rd|d}|jjdur+|j s+|dt|jj7}||jt j <|rYt |t ttfr?|}|D]\}}|dkrQ||j|<qA|j||qAdSdS)zUpdate request headers.[]N:rx)rrTrrMrQrris_ipv6_addressryis_default_portrHOSTrdictrrrloweradd)rZrTnetlockeyvaluerOrOrPrs       zClientRequest.update_headerscCsvtddt|D|_|j}||j|jD]\}}||vr+|j||qt j |vr9t |jt j <dSdS)Ncss|]}|dfVqdSrXrO)rhdrrOrOrPrs z4ClientRequest.update_auto_headers..) rsortedrrTcopyrDEFAULT_HEADERSrrr USER_AGENTr0)rZr used_headersrvalrOrOrPrs   z!ClientRequest.update_auto_headerscCs|sdSt}tj|jvr||jtjd|jtj=t|tr'|}n|}|D]$\}}t|t rK||j t }| |j |j |j |||<q+|||<q+|jddd|jtj<dS)zUpdate request cookies header.Nr;)headersep)rrCOOKIErTloadrfrrrrrsetr coded_valueoutputr)rZrc iter_cookiesnamermrsl_valrOrOrPrs         zClientRequest.update_cookiescCsj|durdS|jtjd}|r|jrtddS|jr3t|jts'd|_|j|jtj<d|_ dSdS)zSet request content encoding.Nrz9compress can not be set if Content-Encoding header is setdeflateT) rTrfrCONTENT_ENCODINGrrrgrrMr)rZrencrOrOrPrs  z%ClientRequest.update_content_encodingcCs|jtjd}d|vr|jrtddS|jr,tj|jvr$tdd|jtj<dStj|jvr?tt |j |jtj<dSdS)z!Analyze transfer-encoding header.rrzDchunked can not be set if "Transfer-Encoding: chunked" header is setz6chunked can not be set if Content-Length header is setN) rTrfrTRANSFER_ENCODINGrrrgCONTENT_LENGTHrMrdbody)rZterOrOrPrs   z&ClientRequest.update_transfer_encodingcCsB|dur|j}|dur dSt|tjstd||jtj<dS)zSet basic auth.Nz%BasicAuth() tuple is required instead) rrrr*rencoderTr AUTHORIZATION)rZrrOrOrPrs zClientRequest.update_authr cCs|durdSt|tr|}z tjj|dd}Wntjy't|}Ynw||_|jsMtj |j vrM|j }|dur?d|_ntj |j vrMt ||j tj <|j sRJ|j D]\}}||j vraqW||jvrgqW||j |<qWdS)N) dispositionT)rr'rPAYLOAD_REGISTRYrf LookupErrorr rrrrTsizerMrr)rZr rrrrOrOrPrs2       z#ClientRequest.update_body_from_dataexpectcCsF|r d|jtj<n|jtjddkrd}|r!|j|_dSdS)Nz 100-continuerT)rTrEXPECTrfrr create_future _continue)rZrrOrOrPrsz$ClientRequest.update_expect_continuecCs.|r t|tjs td||_||_||_dS)Nz,proxy_auth must be None or BasicAuth() tuple)rrr*rgrrr)rZrrrrOrOrPrs  zClientRequest.update_proxycCsL|jtkrdS|jtkr|jtjdkrdSdS|jtjdkr$dSdS)NF keep-aliveTclose)rr1rTrfr CONNECTIONrYrOrOrP keep_alive*s  zClientRequest.keep_alivewriterconnrAc s|jdur|IdH|jIdH|j}|dusJzz5t|jtjr/|j|IdHnt|jtt fr<|jf|_|jD] }||IdHq?| IdHWngt y}z+|j durkt|t jrk||nt|j d|j}||_||_||WYd}~n;d}~wt jy}z|js||WYd}~n'd}~wty}z ||WYd}~nd}~wwWd|_dSWd|_dSWd|_dSWd|_dSd|_w)z-Support coroutines that yields bytes objects.Nz!Can not write request body for %s)rdrainprotocolrr rPayloadwriter| bytearray write_eofOSErrorerrnor~ TimeoutError set_exceptionr"rQ __context__ __cause__CancelledErrorclosed Exception_writer)rZrrrchunkexcnew_excrOrOrP write_bytes8sP            zClientRequest.write_bytesc s|jtjkr&|jj}|dusJt|rd|d}|d|jj}n|jr3| s3t |j}n|jj }|jj rC|d|jj 7}|j }|dusLJt||jt|j|j|jt|j|j|jd}|jrn||j|jdurw||j|jvrtj|jvrtj|jvrd|jtj<|jtj}|s|r|jt krd}n|jt!krd}|dur||jtj<d "|j||j}|#||jIdH|j$|%|||_&|j'}|dusJ||j|j(|j&|j)|j*|j+|j,|j|j-d |_.|j.S) Nrrr?) on_chunk_senton_headers_sentzapplication/octet-streamrrz{0} {1} HTTP/{2[0]}.{2[1]})r continue100rrrrr)/rRr METH_CONNECTrQrrrryrrrMraw_pathraw_query_stringrr3r functoolspartial_on_chunk_request_sent_on_headers_request_sentrenable_compressionrenable_chunking POST_METHODS CONTENT_TYPErrTrfrrrr1r2r write_headers create_taskr.r*rrrrrrrresponse) rZr connect_hostpathrr connection status_linerrOrOrPsend`s                    zClientRequest.sendcs2|jdurz |jIdHWd|_dSd|_wdSrX)r*rYrOrOrPrs  zClientRequest.closecCs,|jdur|js|jd|_dSdSrX)r*r is_closedcancelrYrOrOrP terminates    zClientRequest.terminater+c&|jD] }||||IdHqdSrX)rsend_request_chunk_sent)rZrRrQr+tracerOrOrPr8s z$ClientRequest._on_chunk_request_sentzCIMultiDict[str]crIrX)rsend_request_headers)rZrRrQrTrKrOrOrPr9s z&ClientRequest._on_headers_request_sentrVN)F)rrArVr=)MrJrKrLrMETH_GET METH_HEAD METH_OPTIONS METH_TRACEr METH_PATCH METH_POSTMETH_PUTr<union METH_DELETE ALL_METHODSACCEPTACCEPT_ENCODINGrr rr@r*r frozensetrr2rMrrrr9r r r8r*rrr~AbstractEventLooprr)rr;r?rrlrr}rrrrxrryr>rrrrrrrrrrrrrr r.rErrHr|r8r9rOrOrOrPr<s         J   "    ( Q r<c@seZdZUdZdZeed<dZdZe ed<dZ ded<dZ e ed<dZ dZdZdZd ed ed d d eddedededdejddddfddZedefddZedefddZedefddZedefdd Zedbd!d"Zede fd#d$Z edefd%d&Z!edee"fd'd(Z#e$fd)e%ddfd*d+Z&defd,d-Z'e(ded.fd/d0Z)ede*d1fd2d3Z+edcd5d6Z,ddd8d9Z-ded:d;Z.e(de/fdd?Z1de%fd@dAZ2e(de/fdBdCZ3dedDdEZ4dedFdGZ5dedHdIZ6dedJdKZ7de8fdLdMZ9defdNdOZ:dfdQeedRedefdSdTZ;dedgd[d\Z?d]ee@eAd^eeAd_eeBddfd`daZCdS)hr=NstatuscontentrS_headers _raw_headersTFrRrQrzasyncio.Task[None]r2zasyncio.Future[bool]rrrrBrrr@rVc Cst|tsJ||_t|_||_|d|_d|_||_ ||_ d|_ d|_ ||_ |dur/|nt|_i|_||_||_| |_|rNttd|_dSdS)NTrOr)rrrRrr _real_urlr_url_bodyr*r_closed_history _request_infor,r_cacher_looprrrrrrr) rZrRrQrr2rrrrrrOrOrPrls&  zClientResponse.__init__cCrWrX)rarYrOrOrPrQr\zClientResponse.urlcCstjdtdd|jS)NzDeprecated, use .url #1654r)rrrrarYrOrOrPurl_objszClientResponse.url_objcCrWrX)r`rYrOrOrPrUr\zClientResponse.real_urlcCs|jjdusJ|jjSrX)rarxrYrOrOrPrx szClientResponse.hostcCrWrX)r^rYrOrOrPrTr\zClientResponse.headerscCrWrX)r_rYrOrOrP raw_headersr\zClientResponse.raw_headerscCrWrX)rerYrOrOrPrr\zClientResponse.request_infocCsF|jtj}|dur dSt|\}}t|}t|}t|||SrX) r^rfrCONTENT_DISPOSITIONrparse_content_dispositionrcontent_disposition_filenamerF)rZrawdisposition_type params_dctrrIrOrOrPcontent_dispositions  z"ClientResponse.content_disposition _warningscCs|jrdS|jdurC|j||jrEtrd|i}ni}|jd|tfi||dd}|j r;|j |d<|j |dSdSdS)NsourcezUnclosed response zUnclosed response)client_responsemessagesource_traceback) rc _connectionrelease_cleanup_writerrgrr(rResourceWarningrcall_exception_handler)rZrrkwargscontextrOrOrP__del__&s       zClientResponse.__del__cCsbt}t|j}|jr|jddd}n|j}td||j ||dt|j |d| S)Nasciibackslashreplacez)file) ioStringIOrMrQreasonr decodeprintrr\rTgetvalue)rZoutascii_encodable_urlascii_encodable_reasonrOrOrP__repr__9s" zClientResponse.__repr__rAcCrWrX)rwrYrOrOrPrCKr\zClientResponse.connection)r=.cCrW)z2A sequence of of responses, if redirects occurred.)rdrYrOrOrPhistoryOszClientResponse.history/MultiDictProxy[MultiDictProxy[Union[str, URL]]]c Csd|jdg}|sttSt}td|D]Y}td|}|dur'q|\}}|ddd}t}|D]} td| tj }|durJq;|\} } } } | | | q;| d|} | d |j t || | t|qt|S) Nz, linkz ,(?=\s*<)z \s*<(.*)>(.*)rrz%^\s*(\S*)\s*=\s*(['\"]?)(.*?)(\2)\s*$relrQ)joinrTgetallrrrerrgroupsMrrfrQr) rZ links_strlinksrrrQ params_strrrparamrrzrrOrOrPrTs*    zClientResponse.linksrCc sfd|_|j|_||_|jS z|j}|IdH\}}Wntjy:}zt|j |j |j |j |j d|d}~ww|j dksJ|j dksJ|j dkrKn|jdurYt|jdd|_qWdn1sdwY||j|j|_|j |_|j|_|j |_|j|_||_|j tjdD]"}z|j|Wqty}z t d |WYd}~qd}~ww|S) zStart response processing.FTNr\rurTderOz!Can not load response cookies: %s)!rcr _protocolrwrreadrHttpProcessingErrorr#rrcoderurTrr/on_eof _response_eofrr\rr^rjr_r]rr SET_COOKIErrrr4warning)rZrCrrurr,rrOrOrPstartxsX    zClientResponse.startcCsP|jrdS|jdur|jjdur|jjjrdS|jd|_d|_|dSNT)rcrwrupgradedrxryrYrOrOrPrs    zClientResponse._response_eofcCrWrX)rcrYrOrOrPr(r\zClientResponse.closedcCs\|js||jr dSd|_|jdus|jrdS|jdur(|jd|_|dSr) _released_notify_contentrcrgrFrwrryrYrOrOrPrs   zClientResponse.closecCsH|js||jr tSd|_|jdur|jd|_|tSr)rrrcr-rwrxryrYrOrOrPrxs  zClientResponse.releasecCs d|jkS)zReturns ``True`` if ``status`` is less than ``400``, ``False`` if not. This is **not** a check for ``200 OK`` but a check that the response status is under 400. i)r\rYrOrOrPoks zClientResponse.okcCs<|js|jdus J|t|j|j|j|j|jddS)Nr)rrrxr#rrr\rTrYrOrOrPraise_for_statusszClientResponse.raise_for_statuscCs$|jdur |jd|_d|_dSrX)r*rGrrYrOrOrPrys   zClientResponse._cleanup_writercCs.|j}|r|dur|tdd|_dS)NConnection closedT)r] exceptionr$r!r)rZr]rOrOrPrs zClientResponse._notify_contentcs8|jdurz |jIdHWd|_nd|_w|dSrX)r*rxrYrOrOrPwait_for_closes   zClientResponse.wait_for_closecsz|jdur3z |jIdH|_|jD]}||j|j|jIdHqW|jSty2|w|j r:t d|jS)zRead response payload.Nr) rbr]rrsend_response_chunk_receivedrRrQ BaseExceptionrrr!)rZrKrOrOrPr s"     zClientResponse.readcCs|jtjd}t|}|jd}|r*zt |Wn t y)d}Ynw|sO|j dkr>|j dks;|j dkr>d}n|j durGtdt|j d}|sSd}|S) Nrcharset applicationjsonrdapzutf-8z0Cannot guess the encoding of a not yet read bodyencoding)rTrfrr=rrparse_mimetyperHcodecslookuprrGsubtyperb RuntimeErrorchardetdetect)rZctypemimetyperrOrOrP get_encodings0     zClientResponse.get_encodingstrictrerrorscs:|jdur |IdH|dur|}|jj||dS)z!Read response payload and decode.N)r)rbrrr)rZrrrOrOrPtext6s zClientResponse.textr)rloads content_typerrcs|jdur |IdH|r+|jtjd}t||s+t|j |j d||jd|j }|s4dS|dur<| }|| |S)zRead and decodes JSON response.Nrz3Attempt to decode JSON with unexpected mimetype: %s)rurT)rbrrTrfrr=rrr$rrrrr)rZrrrrstrippedrOrOrPrBs$   zClientResponse.jsoncs|SrXrOrYrOrOrP __aenter__bszClientResponse.__aenter__exc_typeexc_valexc_tbcs|dSrX)rx)rZrrrrOrOrP __aexit__es zClientResponse.__aexit__)rVrS)rVr)rCrArVr=rM)Nr)rVr=)DrJrKrLrr\rrNrr]r5r^r_r:rwrrcrrMrrr)r>rr~r[rlr.rQrirUrxrTrjrrFrqrr r~rr}rCrrrrrrr(rrxrrryrrr|rrrr6r7rrrrr rrOrOrOrPr=s         #    # 3      r=)lr~rr6rrrrrhashlibrrr http.cookiesrrrtypesrr typingr r r r rrrrrrrr] multidictrrrryarlrrrrrrrabcr client_exceptionsr!r"r#r$r%r&formdatar'r(r)r*r+r,r-r.r/r0r1r2r3logr4streamsr5typedefsr6r7r8r9r:rr; ImportErrorobjectcchardetrcharset_normalizer__all__clientr@ connectorrAtracingrBcompilersrFr>r?rrGrr|rrrMrr<r=rOrOrOrPs4    (           " 5  p