o tf:@sdZddlZddlZddlZddlZddlZddlZddlZddlZddl Z ddl m Z m Z m Z da ejejfejejfgZddZddZdd Zd d Zd d ZddZGdddeZGdddeZGdddeZddZddZd ddZddZ e!dkre dSdS)!aA server to hand out network ports to applications running on one host. Typical usage: 1) Run one instance of this process on each of your unittest farm hosts. 2) Set the PORTSERVER_ADDRESS environment variable in your test runner environment to let the portpicker library know to use a port server rather than attempt to find ports on its own. $ /path/to/portserver.py & $ export PORTSERVER_ADDRESS=@unittest-portserver $ # ... launch a bunch of unittest runners using portpicker ... N)datetimetimezone timedeltacC(zt|WStjyYdSw)N)psutilProcessZcmdline NoSuchProcesspidr `/var/www/html/software/conda/envs/catlas/lib/python3.10/site-packages/../../../bin/portserver.py_get_process_command_line/ rcCr)N)rrZ create_timer r r r r _get_process_start_time6rrc Csd}tjtjfD]W}z t|||}d}Wn tjyYqwz:z"|tjtjd|d|f|tjkr<| d| d}WntjyTYW| dSwW| q| w|rd|SdS)aTry to bind to a socket of the specified type, protocol, and port. For the port to be considered available, the kernel must support at least one of (IPv6, IPv4), and the port must be available on each supported family. Args: port: The port number to bind to, or 0 to have the OS pick a free port. socket_type: The type of the socket (ex: socket.SOCK_STREAM). socket_proto: The protocol of the socket (ex: socket.IPPROTO_TCP). Returns: The port number on success or None on failure. FTrN) socketAF_INET6AF_INETerror setsockopt SOL_SOCKET SO_REUSEADDRbind SOCK_STREAMlisten getsocknameclose)port socket_typeZ socket_protoZ got_socketfamilysockr r r _bind>s*   r#cCs(t|gtdRot|gtdRS)zCheck if specified port is free. Args: port: integer, port to check Returns: boolean, whether it is free to use for both TCP and UDP rr)r#_PROTOSrr r r _is_port_freeas(r&cCsH|dkr tddS|dkrtddSt|s"tddSdS)zGDetermine if we should allocate a port for use by the given process id.rz$Not allocating a port to invalid pidFrzNot allocating a port to init.z/Not allocating a port to a non-existent processT)loginforZ pid_existsr r r r _should_allocate_portls    r)cs2fdd}t}|j||dIdH^}}|S)z.Start the server on Windows using named pipes.cst}t|}|SN)asyncio StreamReaderStreamReaderProtocol) stream_readerZstream_reader_protocolclient_connected_cbr r protocol_factorys z/_start_windows_server..protocol_factory)addressN)r+get_event_loopZstart_serving_pipe)r0pathr1loopserver_r r/r _start_windows_server}s  r8c@seZdZdZdZddZdS) _PortInfozContainer class for information about a given port assignment. Attributes: port: integer port number pid: integer process id or 0 if unassigned. start_time: Time in seconds since the epoch that the process started. rr start_timecCs||_d|_d|_dS)Nrrr:)selfrr r r __init__s z_PortInfo.__init__N)__name__ __module__ __qualname____doc__ __slots__r=r r r r r9s r9c@0eZdZdZddZddZddZdd Zd S) _PortPoolaManage available ports for processes. Ports are reclaimed when the reserving process exits and the reserved port is no longer in use. Only ports which are free for both TCP and UDP will be handed out. It is easier to not differentiate between protocols. The pool must be pre-seeded with add_port_to_free_pool() calls after which get_port_for_process() will allocate and reclaim ports. The len() of a _PortPool returns the total number of ports being managed. Attributes: ports_checked_for_last_request: The number of ports examined in order to return from the most recent get_port_for_process() request. A high number here likely means the number of available ports with no active process using them is getting low. cCst|_d|_dS)Nr) collectionsdeque _port_queueports_checked_for_last_requestr<r r r r=s  z_PortPool.__init__cCs t|jSr*)lenrGrIr r r num_portss z_PortPool.num_portscCs|jstdd}t|j}||krW|j}|j||d7}|jdks.|jt|jkrSt|j rJ||_t||_|jsDt d|||_ |j St d|j |j||kst d||_ dS)zCAllocates and returns port for pid or 0 if none could be allocated.zNo ports being managed.rrrz!Can't read start time for pid %d.z0Port %d unexpectedly in use, last owning pid %d.zAll ports in use.) rG RuntimeErrorrJpop appendleftr;rr r&rr'r(rH)r<r Z check_countZmax_ports_to_test candidater r r get_port_for_processs2        z_PortPool.get_port_for_processcCs6|dks|dkrtd|t|d}|j|dS)z/Add a new port to the free pool for allocation.rz-Port must be in the [1, 65535] range, not %d.r%N) ValueErrorr9rGappend)r<rZ port_infor r r add_port_to_free_pools  z_PortPool.add_port_to_free_poolN)r>r?r@rAr=rKrPrTr r r r rDs  rDc@rC) _PortServerRequestHandleraA class to handle port allocation and status requests. Allocates ports to process ids via the dead simple port server protocol when the handle_port_request asyncio.coroutine handler has been registered. Statistics can be logged using the dump_stats method. cCs4t|_d|_d|_d|_|D]}|j|qdS)zInitialize a new port server. Args: ports_to_serve: A sequence of unique port numbers to test and offer up to clients. rN)rD _port_pool_total_allocations_denied_allocations_client_request_errorsrT)r<ports_to_serverr r r r=sz"_PortServerRequestHandler.__init__cs*|dIdH}||||dS)Nd)read_handle_port_requestr)r<readerwriter client_datar r r handle_port_requests  z-_PortServerRequestHandler.handle_port_requestc Cszt|dkr tdt|}Wn ty0}z|jd7_td|WYd}~dSd}~wwtd|tdt|t|sL|j d7_ dS|j |}|dkrq|j d7_ | d |d td ||dS|j d7_ dS) zGiven a port request body, parse it and respond appropriately. Args: client_data: The request bytes from the client. writer: The asyncio Writer for the response to be written to. z!More than 20 characters in "pid".rzCould not parse request: %sNzRequest on behalf of pid %d.z cmdline: %srz{:d} zutf-8zAllocated port %d to pid %d)rJrRintrYr'warningr(rr)rXrVrPrWwriteformatencodedebug)r<r`r_r rrr r r r]s*     z._PortServerRequestHandler._handle_port_requestcCstdg}|d|j|d|j|d|j|d|jj|d|j |D]}t|q9dS)z!Logs statistics of our operation.zDumping statistics:zclient-request-errors {}zdenied-allocations {}znum-ports-managed {}z%num-ports-checked-for-last-request {}ztotal-allocations {}N) r'r(rSrfrYrXrVrKrHrW)r<statsstatr r r dump_statss   z$_PortServerRequestHandler.dump_statsN)r>r?r@rAr=rar]rkr r r r rUs  rUcCsft}|jdtddd|jddtddd|jd d d d d |jdd d dd |tjddS)z+Configure and parse our command line flags.z--portserver_static_poolz 15000-24999z.listen_for_signalr@z \\.\pipe\)r4) r5r4z Serving on %szStopping due to ^C.zGoodbye.)$ryrhr+tasks_DEBUGrrrZportserver_static_poolr'rrvexitrUplatformset_event_loopZProactorEventLoopr3rr8raZportserver_addressreplaceadd_signal_handlersignalSIGUSR1rk version_infostart_unix_serverrun_until_completer( run_foreverKeyboardInterruptr wait_closedremove_signal_handler)configrZZrequest_handlercoroZ old_py_loopserver_addressr6r rr mainbsZ            r__main__)FF)"rArqr+rErrrrvr subprocessrrrr'r IPPROTO_TCP SOCK_DGRAM IPPROTO_UDPr$rrr#r&r)r8objectr9rDrUryrrrr>r r r r s>   # AI <