tfdZddlmZddlmZddlmZmZmZddl m Z ddl m Z ddl mZdd lmZGd d Ze e Gd d ZdS)zZ Implementation of a L{Team} of workers; a thread-pool that can allocate work to workers. ) annotations)deque)CallableOptionalSet) implementer)IWorker)Quit)IExclusiveWorkerceZdZdZd dZd S) Statisticsa Statistics about a L{Team}'s current activity. @ivar idleWorkerCount: The number of idle workers. @type idleWorkerCount: L{int} @ivar busyWorkerCount: The number of busy workers. @type busyWorkerCount: L{int} @ivar backloggedWorkCount: The number of work items passed to L{Team.do} which have not yet been sent to a worker to be performed because not enough workers are available. @type backloggedWorkCount: L{int} idleWorkerCountintbusyWorkerCountbackloggedWorkCountreturnNonec0||_||_||_dSN)rrr)selfrrrs U/var/www/surfInsights/venv3-11/lib/python3.11/site-packages/twisted/_threads/_team.py__init__zStatistics.__init__%s" /.#6   N)rrrrrrrr)__name__ __module__ __qualname____doc__rrrrrs2  777777rrc^eZdZdZddZdd ZddZdd dZdd dZd!dZ d"dZ d#dZ d$dZ dS)%Teamax A composite L{IWorker} implementation. @ivar _quit: A L{Quit} flag indicating whether this L{Team} has been quit yet. This may be set by an arbitrary thread since L{Team.quit} may be called from anywhere. @ivar _coordinator: the L{IExclusiveWorker} coordinating access to this L{Team}'s internal resources. @ivar _createWorker: a callable that will create new workers. @ivar _logException: a 0-argument callable called in an exception context when there is an unhandled error from a task passed to L{Team.do} @ivar _idle: a L{set} of idle workers. @ivar _busyCount: the number of workers currently busy. @ivar _pending: a C{deque} of tasks - that is, 0-argument callables passed to L{Team.do} - that are outstanding. @ivar _shouldQuitCoordinator: A flag indicating that the coordinator should be quit at the next available opportunity. Unlike L{Team._quit}, this flag is only set by the coordinator. @ivar _toShrink: the number of workers to shrink this L{Team} by at the next available opportunity; set in the coordinator. coordinatorr createWorkerCallable[[], Optional[IWorker]] logExceptionCallable[[], None]ct|_||_||_||_t |_d|_t|_ d|_ d|_ dS)a @param coordinator: an L{IExclusiveWorker} which will coordinate access to resources on this L{Team}; that is to say, an L{IExclusiveWorker} whose C{do} method ensures that its given work will be executed in a mutually exclusive context, not in parallel with other work enqueued by C{do} (although possibly in parallel with the caller). @param createWorker: A 0-argument callable that will create an L{IWorker} to perform work. @param logException: A 0-argument callable called in an exception context when the work passed to C{do} raises an exception. rFN) r _quit _coordinator _createWorker _logExceptionset_idle _busyCountr_pending_shouldQuitCoordinator _toShrink)rr"r#r%s rrz Team.__init__MsY(VV '))$'55 8= &+#rrrcvtt|j|jt|jS)z Gather information on the current status of this L{Team}. @return: a L{Statistics} describing the current state of this L{Team}. )rlenr-r.r/rs r statisticszTeam.statisticsms* #dj//4?C .createOneWorker~sV1XX , ,++-->FF##F++++  , ,rNrrr(checkr)do)rr6r=s`` rgrowz Team.growusX    , , , , , ,   , , ,rN Optional[int]cxjjfddS)z Decrease the number of idle workers by C{n}. @param n: The number of idle workers to shut down, or L{None} (or unspecified) to shut down all workers. @type n: L{int} or L{None} c.Sr) _quitIdlers)r6rsrzTeam.shrink..sT%5%5a%8%8rNr?)rr6s``rshrinkz Team.shrinksD  8888899999rcJ|t|j|jz}t|D]E}|jr,|j5|xjdz c_F|jr&|jdkr|jdSdSdS)z| The implmentation of C{shrink}, performed by the coordinator worker. @param n: see L{Team.shrink} Nr r) r3r-r.r9popquitr1r0r))rr6r;s rrFzTeam._quitIdlerss 9DJ$/1Aq $ $Az $   %%''''!#  & %4?a+?+?   " " $ $ $ $ $ % %+?+?rtaskcxjjfddS)zu Perform some work in a worker created by C{createWorker}. @param task: the callable to run c.Sr)_coordinateThisTaskrrLsrrGzTeam.do..sT%=%=d%C%CrNr?rPs``rrAzTeam.dosD  CCCCCDDDDDrCallable[..., object]cjrjn}|jdS|xjdz c_|jdfd }dS)z Select a worker to dispatch to, either an idle one or a new one, and perform it. This method should run on the coordinator worker. @param task: the task to dispatch @type task: 0-argument callable Nr rrc n$#t$rYnwxYwjjdfd }dS)NrrcRxjdzc_dS)Nr )r.r:)not_none_workerrsridleAndPendingz@Team._coordinateThisTask..doWork..idleAndPendings-1$##O44444rr>) BaseExceptionr+r)rA)rVrUrrLs rdoWorkz(Team._coordinateThisTask..doWorks %  % % %""$$$$$ %  ! 5 5 5 5 5 5" ! 5 5 5s //r>)r-rJr*r/appendr.rA)rrLr<rXrUs`` @rrOzTeam._coordinateThisTasks&*ZI!!!T5G5G5I5I > M  & & & F  1  5 5 5 5 5 5 5  5 5 5rr<r ct|j||jr.||jdS|jr|dS|jdkr@|xjdzc_|j|| dSdS)z Called only from coordinator. Recycle the given worker into the idle pool. @param worker: a worker created by C{createWorker} and now idle. @type worker: L{IWorker} rr N) r-addr/rOpopleftr0rFr1removerK)rr<s rr:zTeam._recycleWorkers v =   $ $T]%:%:%<%< = = = = =  (          ^a   NNa NN J  f % % % KKMMMMM rcjjjjdfd }dS)zA Stop doing work and shut down all idle workers. rrc>d_dS)NT)r0rFr4srstartFinishingz!Team.quit..startFinishings#*.D '        rNr>)r(r,r)rA)rr`s` rrKz Team.quitsR              r)r"r r#r$r%r&)rr)r6rrrr)r6rCrr)rLr&rr)rLrQrr)r<r rrr>) rrrrrr5rBrHrFrArOr:rKrrrr!r!-s<@PPPP,,,," : : : : :%%%%% EEEE5555>*      rr!N)r __future__r collectionsrtypingrrrzope.interfacerr _conveniencer _ithreadsr rr!rrrrhs #"""""**********&&&&&&''''''777777770 Wzzzzzzzzzzr