3dbdZddlmZmZddlmZddlmZddlm Z ddl m Z ddl m Z ddlmZdd lmZGd d eZd S) z This module implements the Response class which is used to represent HTTP responses in Scrapy. See documentation in docs/topics/request-response.rst ) GeneratorTuple)urljoin NotSupported)obsolete_setter)Headers)Request)Link) object_refceZdZUdZdZeedfed< ddefd Ze d Z e d Z d Z defd Z e e ee dZdZdZe eeedZdZdZdZdZe dZdZdZ d defdZ d deeddffdZdS)!ResponsezAn object that represents an HTTP response, which is usually downloaded (by the Downloader) and fed to the Spiders for processing. ) urlstatusheadersbodyflagsrequest certificate ip_addressprotocol. attributesNrc t|pi|_t||_||||||_|gnt||_||_ ||_ | |_ dSN) r rintr _set_body_set_urlrlistrrrr) selfrrrrrrrrrs =lib/python3.11/site-packages/scrapy/http/response/__init__.py__init__zResponse.__init__)sw}"-- &kk  t c  9RRd5kk &$  rcV |jjS#t$rtdwxYw)NzJResponse.cb_kwargs not available, this response is not tied to any request)r cb_kwargsAttributeErrorr!s r"r%zResponse.cb_kwargs?sD <) )    -   (cV |jjS#t$rtdwxYw)NzEResponse.meta not available, this response is not tied to any request)rmetar&r's r"r*z Response.metaIsD <$ $    -  r(c|jSr)_urlr's r"_get_urlzResponse._get_urlSs yrct|tr ||_dStt |jdt |j)Nz url must be str, got ) isinstancestrr, TypeErrortype__name__r!rs r"rzResponse._set_urlVsT c3   DIII::&VV$s))BTVV rc|jSr)_bodyr's r" _get_bodyzResponse._get_body`s zrcr| d|_dSt|tstd||_dS)Nrz_Response body must be bytes. If you want to pass unicode body use TextResponse or HtmlResponse.)r6r/bytesr1)r!rs r"rzResponse._set_bodycsK  DJJJD%(( #  DJJJrrc(d|jd|jdS)N< >)rrr's r"__repr__zResponse.__repr__qs,4;,,,,,,rc*|S)zReturn a copy of this Response)replacer's r"copyz Response.copyts||~~rc|jD]&}||t||'|d|j}||i|S)zPCreate a new Response with the same attributes except for those given new valuescls)r setdefaultgetattrpop __class__)r!argskwargsxrCs r"r@zResponse.replacexs` 3 3A   aq!1!1 2 2 2 2jj//sD#F###rc,t|j|S)zoJoin this Response's url with a possible relative url to form an absolute interpretation of the latter.)rrr4s r"rzResponse.urljoinstx%%%rc td)zQFor subclasses of TextResponse, this will return the body as str Response content isn't text)r&r's r"textz Response.texts :;;;rc tdzrShortcut method implemented only by responses whose content is text (subclasses of TextResponse). rMrr!akws r"cssz Response.css8999rc tdrPrrQs r"xpathzResponse.xpathrUrGETutf-8rFreturnct|tr|j}n|td||}t ||||||||| | | | |  S)a Return a :class:`~.Request` instance to follow a link ``url``. It accepts the same arguments as ``Request.__init__`` method, but ``url`` can be a relative URL or a ``scrapy.link.Link`` object, not only an absolute URL. :class:`~.TextResponse` provides a :meth:`~.TextResponse.follow` method which supports selectors in addition to absolute/relative URLs and Link objects. .. versionadded:: 2.0 The *flags* parameter. Nzurl can't be None rcallbackmethodrrcookiesr*encodingpriority dont_filtererrbackr%r)r/r r ValueErrorrr )r!rr]r^rrr_r*r`rarbrcr%rs r"followzResponse.follows: c4  2'CC  2011 1ll3#    rc  t|dstd    f d|DS)a .. versionadded:: 2.0 Return an iterable of :class:`~.Request` instances to follow all links in ``urls``. It accepts the same arguments as ``Request.__init__`` method, but elements of ``urls`` can be relative URLs or :class:`~scrapy.link.Link` objects, not only absolute URLs. :class:`~.TextResponse` provides a :meth:`~.TextResponse.follow_all` method which supports selectors in addition to absolute/relative URLs and Link objects. __iter__z#'urls' argument must be an iterablec3\ K|]&}|    V'dS)r\N)re).0rrr]r%r_rbr`rcrrr*r^rar!s r" z&Response.follow_all..ss   KK!!!'#         r)hasattrr1)r!urlsr]r^rrr_r*r`rarbrcr%rs` ````````````r" follow_allzResponse.follow_alls8tZ(( CABB B                !    r)rNrNNNNN) NrXNNNNrYrFNNN)r3 __module__ __qualname____doc__rrr0__annotations__r#propertyr%r*r-rrrr7rrr>rAr@rrNrTrWr rerrmrr"rrsP #Jc3h    !! !!!!,XXC (8__Xu== > >C    8Iy&AA B BD---$$$&&& <<X< ::: :::  1 1  1 1 1 1 l  / /  7D$& '/ / / / / / rrN)rptypingrr urllib.parserscrapy.exceptionsrscrapy.http.commonrscrapy.http.headersr scrapy.http.requestr scrapy.linkr scrapy.utils.trackrefr rrsrr"r|s $####### ******......'''''''''''',,,,,,g g g g g zg g g g g r