o tf1@sdZddlZddlZddlZddlZddlZddlZddlZddlm Z ddl m Z m Z m Z ddlmZddlmZddlmZddlZddlmZmZmZejrWdd lmZejZd efd d Zdd dZda ddeedeed efddZd eefddZ Gddde!Z"dS)zUtilities for working with multiple processes, including both forking the server into multiple processes and managing subprocesses. N)hexlify)Future"future_set_result_unless_cancelled%future_set_exception_unless_cancelled)ioloop) PipeIOStream)gen_log)OptionalAnyCallable)Listreturnc Cs\tdurdSztWStyYnwztdWSttfy&YnwtddS)z1Returns the number of processors on this machine.NSC_NPROCESSORS_CONFz1Could not detect number of processors; assuming 1) multiprocessing cpu_countNotImplementedErrorossysconfAttributeError ValueErrorrerrorrrX/var/www/html/software/conda/envs/catlas/lib/python3.10/site-packages/tornado/process.pyr1s    rcCshdtjvrdSddl}z tttdd}Wnty,ttdt A}Ynw| |dS)Nrandomri) sysmodulesrintrrurandomrtimegetpidseed)rr"rrr_reseed_randomAs  r# num_processes max_restartsc sNtjdkr td|durd}tdusJ|dus|dkr t}td|idtdttffd d }t |D]}||}|durG|Sq9d}rt \}}|vrWqJ |}t |rmtd ||t |nt |dkrtd ||t |ntd ||qJ|d7}||krtd||}|dur|SsLtddS)aqStarts multiple worker processes. If ``num_processes`` is None or <= 0, we detect the number of cores available on this machine and fork that number of child processes. If ``num_processes`` is given and > 0, we fork that specific number of sub-processes. Since we use processes and not threads, there is no shared memory between any server code. Note that multiple processes are not compatible with the autoreload module (or the ``autoreload=True`` option to `tornado.web.Application` which defaults to True when ``debug=True``). When using multiple processes, no IOLoops can be created or referenced until after the call to ``fork_processes``. In each child process, ``fork_processes`` returns its *task id*, a number between 0 and ``num_processes``. Processes that exit abnormally (due to a signal or non-zero exit status) are restarted with the same id (up to ``max_restarts`` times). In the parent process, ``fork_processes`` calls ``sys.exit(0)`` after all child processes have exited normally. max_restarts defaults to 100. Availability: Unix win32zfork not available on windowsNdrzStarting %d processesir cs*t}|dkrt|a|S||<dSNr)rforkr#_task_id)r(pidchildrenrr start_childsz#fork_processes..start_childz1child %d (pid %d) killed by signal %d, restartingz3child %d (pid %d) exited with status %d, restartingz!child %d (pid %d) exited normallyrz"Too many child restarts, giving up)rplatform Exceptionr+rrinforr rangerwaitpop WIFSIGNALEDwarningWTERMSIG WEXITSTATUS RuntimeErrorexit) r$r%r/r(idZ num_restartsr,statusZnew_idrr-rfork_processesSsZ        r>cCstS)zpReturns the current task id, if any. Returns None if this process was not created by `fork_processes`. )r+rrrrtask_idsr?c@seZdZdZeZdZiZdededdfddZ d e e gdfddfd d Z dd e ddfddZedddZedddZedddZede ddfddZde ddfddZdS) Subprocessa Wraps ``subprocess.Popen`` with IOStream support. The constructor is the same as ``subprocess.Popen`` with the following additions: * ``stdin``, ``stdout``, and ``stderr`` may have the value ``tornado.process.Subprocess.STREAM``, which will make the corresponding attribute of the resulting Subprocess a `.PipeIOStream`. If this option is used, the caller is responsible for closing the streams when done with them. The ``Subprocess.STREAM`` option and the ``set_exit_callback`` and ``wait_for_exit`` methods do not work on Windows. There is therefore no reason to use this class instead of ``subprocess.Popen`` on that platform. .. versionchanged:: 5.0 The ``io_loop`` argument (deprecated since version 4.1) has been removed. Fargskwargsr Nc Osptj|_g}g}|dtjur-t\}}||d<| ||f| |t ||_ |dtjurPt\}}||d<| ||f| |t ||_ |dtjurst\} } | |d<| | | f| | t | |_z tj|i||_Wn|D]} t| q|D]} t| q|jj|_dD]} t|| st|| t|j| qd|_d|_dS)Nstdinstdoutstderr)rCrDrE)rZIOLoopcurrentio_loopgetr@STREAMrpipeextendappendrrCrDrE subprocessPopenproccloser,hasattrsetattrgetattr_exit_callback returncode) selfrArBZpipe_fdsto_closeZin_rZin_wZout_rZout_wZerr_rZerr_wfdattrrrr__init__sH               zSubprocess.__init__callbackcCs*||_t|tj|j<t|jdS)aRuns ``callback`` when this process exits. The callback takes one argument, the return code of the process. This method uses a ``SIGCHLD`` handler, which is a global setting and may conflict if you have other libraries trying to handle the same signal. If you are using more than one ``IOLoop`` it may be necessary to call `Subprocess.initialize` first to designate one ``IOLoop`` to run the signal handlers. In many cases a close callback on the stdout or stderr streams can be used as an alternative to an exit callback if the signal handler is causing a problem. Availability: Unix N)rTr@ initialize_waitingr,_try_cleanup_process)rVr[rrrset_exit_callbacks zSubprocess.set_exit_callbackT raise_errorz Future[int]cs,tdtddffdd }||S)a2Returns a `.Future` which resolves when the process exits. Usage:: ret = yield proc.wait_for_exit() This is a coroutine-friendly alternative to `set_exit_callback` (and a replacement for the blocking `subprocess.Popen.wait`). By default, raises `subprocess.CalledProcessError` if the process has a non-zero exit status. Use ``wait_for_exit(raise_error=False)`` to suppress this behavior and return the exit status without raising. .. versionadded:: 4.2 Availability: Unix retr Ncs.|dkrrtt|ddSt|dS)Nrunknown)rCalledProcessErrorr)rafuturer`rrr[(s  z*Subprocess.wait_for_exit..callback)rrr_)rVr`r[rrdr wait_for_exits zSubprocess.wait_for_exitcCs,|jrdSt}|tj|jd|_dS)aInitializes the ``SIGCHLD`` handler. The signal handler is run on an `.IOLoop` to avoid locking issues. Note that the `.IOLoop` used for signal handling need not be the same one used by individual Subprocess objects (as long as the ``IOLoops`` are each running in separate threads). .. versionchanged:: 5.0 The ``io_loop`` argument (deprecated since version 4.1) has been removed. Availability: Unix NT) _initializedasyncioget_event_loopadd_signal_handlersignalSIGCHLD_cleanupclslooprrrr\4s  zSubprocess.initializecCs(|jsdSt}|tjd|_dS)z Removes the ``SIGCHLD`` handler.NF)rgrhriremove_signal_handlerrkrlrnrrr uninitializeIs   zSubprocess.uninitializecCs"t|jD]}||qdSN)listr]keysr^)ror,rrrrmRs zSubprocess._cleanupr,cCsdz t|tj\}}Wn tyYdSw|dkrdS||ks"J|j|}|j|j|dSr)) rwaitpidWNOHANGChildProcessErrorr]r5rGZ add_callback_set_returncode)ror,Zret_pidr=Zsubprocrrrr^Ws   zSubprocess._try_cleanup_processr=cCsttjdkr d|_nt|rt| |_n t|sJt||_|j|j_|j r8|j }d|_ ||jdSdS)Nr&) rr0rUrr6r8 WIFEXITEDr9rOrT)rVr=r[rrrrycs    zSubprocess._set_returncode)Tr N)__name__ __module__ __qualname____doc__objectrIrgr]r rZr rr_boolrf classmethodr\rrrmr^ryrrrrr@s"'    r@r|rs)#rrhrrrkrMrr binasciirZtornado.concurrentrrrtornadorZtornado.iostreamrZ tornado.logrtypingr r r TYPE_CHECKINGr rcrrr#r+r>r?rr@rrrrs>       `