3 d
U d Z ddlZddlZddlZddlZddlmZmZmZm Z m
Z
m Z ddl m
Z
ddlmZ ddlmZ ddlZddlmZ ddlmZ dd lmZmZ e
Zd
ed < d d
de fdZ e
Z ded< d d d
de ee de e
d e
e e f f fdZ de e!e e"e f de fdZ#ed ede!fd Z$ej% fd e d dee gef defdZ&dS ) zZ
This module provides some useful functions for working with
scrapy.http.Response objects
N)AnyCallableIterableOptionalTupleUnion)WeakKeyDictionary)http)html)Response)
deprecated)to_bytes
to_unicodez WeakKeyDictionary[Response, str]_baseurl_cacheresponse&scrapy.http.response.text.TextResponsereturnc | t vr7| j dd }t j || j | j t | < t | S )zGReturn the base url of the given response, joined with the response urlr )r textr get_base_urlurlencoding)r r s 5lib/python3.11/site-packages/scrapy/utils/response.pyr r sO ~%
}QtV$#'#4 (, 1$
$
x ( ## zHWeakKeyDictionary[Response, Union[Tuple[None, None], Tuple[float, str]]]_metaref_cachescriptnoscript ignore_tags)NNc | t vr9| j dd }t j || j | j | t | < t | S )z>Parse the http-equiv refresh parameter from the given responser r )r )r r r get_meta_refreshr r )r r r s r r" r" & sX
~%
}QtV$#'#8 (, 1{$
$
$
x ( ##r statusc t | }t j |d }| dt | S )z7Return status code plus status text descriptive messagezUnknown Status )intr
RESPONSESgetr )r#
status_intmessages r response_status_messager+ 3 sA VJn -=>>G 0 0:g.. 0 00r c z dt t | j dt t j | j d dg}| j r.| | j dg | d| j g d
| S )zReturn raw HTTP representation (as bytes) of the given response. This
is provided only for reference, since it's not the exact stream of bytes
that was received (that's not exposed by Twisted).
s HTTP/1.1 r s
) r strr# r
r' r( headersextend to_stringbodyjoin)r valuess r response_httpreprr5 : s X_%%&& ##HOS99:: F ?
x'1133W=>>>
MM7HM*+++ 88F r )z&scrapy.http.response.html.HtmlResponser _openfuncc ddl m}m} | j }t | | rWd|vrPd| j d}t
j dd|t j }t
j d t | | }d
}n/t | | rd }n t d | j j t j | \ }}t j || t j | |d
| S )zmOpen the given response in a local web browser, populating the
tag for external links to work
r ) HtmlResponse TextResponses s
r )flagss (|\s.*?>))z.htmlz.txtzUnsupported response type: zfile://) scrapy.httpr8 r9 r2
isinstancer resubDOTALLr TypeError __class____name__tempfilemkstemposwriteclose) r r6 r8 r9 r2 replextfdfnames r open_in_browserrL M s 76666666 =D(L)) X 4 I5X\555D6-d")DDDD618D>>4HHD Hl + + XV9K9TVVWWW %%IBHRHRLLL 9&u&& ' ''r )r )'__doc__rE r= rC
webbrowsertypingr r r r r r weakrefr twisted.webr
w3libr scrapyscrapy.http.responser scrapy.utils.decoratorsr
scrapy.utils.pythonr r r __annotations__r. r r floatr" bytesr& r+ r5 openrL r r r\ s]
B B B B B B B B B B B B B B B B % % % % % %
) ) ) ) ) ) . . . . . . 4 4 4 4 4 4 4 45F5F5H5H2 H H H$C $ $ $ $ $ Z ,B
$
$6
$(3-(
$ 5 eE3J / /0
$
$
$
$1E%S*@$A 1c 1 1 1 1 U . '1o ( ( 2(
s
# (
( ( ( ( ( (r