3ddZddlZddlZddlmZddlmZddlmZddl m Z ddl m Z ddl mZd Zd Zd Z dd ZddZdefdZdZddZdZdZdZdS)z< This module contains some assorted functions used in tests N) import_module)Path)split)mock)SkipTest)is_botocore_availablec@dtjvrtddS)NGCS_PROJECT_IDzGCS_PROJECT_ID not found)osenvironr1lib/python3.11/site-packages/scrapy/utils/test.pyassert_gcs_environrs*rz)3122233rc@tstddS)Nzmissing botocore library)rrr rrskip_if_no_botors) " "3122233rcLddlm}|tjd}||}||}|}t|j }| ||||fS)Nr)storager )project) google.cloudrClientr r get get_bucketget_blobdownload_as_stringlistacl delete_blob)bucketpathrclientblobcontentrs rget_gcs_content_and_deleter$s$$$$$$ ^^BJNN3C$D$D^ E EF   v & &F ??4 D%%''G tx..C t C rFc ddlm}|}|||||||r|dg fd}|d||t |\} } || || d S)Nr)FTPFc2|dSN)append)dataftp_datas r buffer_dataz/get_ftp_content_and_delete..buffer_data3srzRETR ) ftplibr&connectloginset_pasv retrbinaryrcwddeletejoin) r hostportusernamepassworduse_active_moder&ftpr,dirnamefilenamer+s @rget_ftp_content_and_deleter>'s #%%CKKdIIh!!! UHNN>4>>;///d GXGGGJJx 778  rTcddlm}ddlm}i}|rd|d<||pi||}||p|S)zReturn an unconfigured Crawler object. If settings_dict is given, it will be used to populate the crawler settings with a project level priority. r) CrawlerRunner)Spiderz2.7$REQUEST_FINGERPRINTER_IMPLEMENTATION)scrapy.crawlerr@scrapy.spidersrAupdatecreate_crawler) spidercls settings_dictprevent_warningsr@rAsettingsrunners r get_crawlerrL=s -,,,,,%%%%%%HA;@78 OOM'R((( ]8 $ $F  !4f 5 55rreturnctdjd}tt|jt jzt jddzS)zbReturn a PYTHONPATH suitable to use in processes so that they find this installation of Scrapyscrapyr PYTHONPATHr-) r__path__strrparentr pathsepr r) scrapy_paths rget_pythonpathrVNsO ))215K tK  ' ( (2: 5 |UW8X8X XXrcdtj}t|d<|S)zReturn a OS environment dict suitable to fork processes that need to import this installation of Scrapy, instead of a system installed one. rP)r r copyrV)envs r get_testenvrZUs* *//  C&((C  Jrc|||||dS)zlAsserts text1 and text2 have the same lines, ignoring differences in line endings between platforms N) assertEqual splitlines)testcasetext1text2msgs rassert_samelinesrb^s: ))++U-=-=-?-?EEEEErc~tj}|}|||Sr()asyncioQueuer put_nowait)valueqgetters rget_from_asyncio_queuerjes1 A UUWWFLL Mrcddlm}m}m}t j|}t j|}||j_t j|}||j_|||fS)z|Creates autospec mocks for google-cloud-storage Client, Bucket and Blob classes and set their proper return values. r)BlobBucketr) google.cloud.storagerlrmrrcreate_autospecr return_valuer")rlrmr client_mock bucket_mock blob_mocks rmock_google_cloud_storagertlsu:999999999&v..K&v..K*5K'$T**I$-K! i 00rcddlm}ddlm}||}|d|dS)Nr)reactor)AgentsGETzutf-8)twisted.internetrvtwisted.web.clientrwrequestencode)urlrvrwagents rget_web_client_agent_reqr~}sS(((((((((((( E'NNE ==G!4!4 5 55r)F)NNTr()__doc__rdr importlibrpathlibr posixpathrunittestrtwisted.trial.unittestrscrapy.utils.botorrrr$r>rLrRrVrZrbrjrtr~r rrrsh ######++++++333333333 333   ;@,6666"YYYYYFFFF111"66666r