tf2dZddlZddlZddlZ ddlZn #e$rdZYnwxYwddlmZddlm Z m Z ddl m Z m Z ddlmZmZddlmZmZmZmZmZmZmZmZmZmZmZddlmZdd lm Z dd l!m"Z"ee j#$e  d Gd d e"Z%ee j#$e  d Gdde"Z&dS)z Whitebox tests for TCP APIs. N)skipIf) interfacesreactor) gatherResults maybeDeferred)Protocol ServerFactory) _ACCEPT_ERRORSEAGAIN ECONNABORTED EINPROGRESSEMFILEENFILEENOBUFSENOMEMEPERM EWOULDBLOCKPort)log)platform)TestCasez?This test only applies to reactors that implement IReactorFDsetcteZdZdZdZdZdZdZee j dkddZ d S) PlatformAssumptionsTestsz4 Test assumptions about platform behaviors. i cg|_t{ddlm}t |dz}tjtj|_tjtj||jdf|dz|_ dSdS)Nr) _listOpenFDsd) openSocketsresourcetwisted.internet.processrlen getrlimit RLIMIT_NOFILEoriginalFileLimit setrlimit socketLimit)selfrnewLimits ^/var/www/surfInsights/venv3-11/lib/python3.11/site-packages/twisted/test/test_tcp_internals.pysetUpzPlatformAssumptionsTests.setUp4s   > = = = = =<<>>**Q.H%-%78N%O%OD "  &43I!3L(M    (#~D    cJ|jr2|j|j2tbtjtjd}t |jd|}tjtj||fdSdS)Nrr) rpopcloser r#r$minr%r&)r(currentHardLimit newSoftLimits r*tearDownz!PlatformAssumptionsTests.tearDownFs +   " " ( ( * * * +   (1(2HII!L t5a8:JKKL  x5 FV7W X X X X X r,c`tj}|j||S)z| Create and return a new socket object, also tracking it so it can be closed in the test tear down. )socketrappend)r(ss r*r5zPlatformAssumptionsTests.socketRs+ MOO """r,win32zhWindows requires an unacceptably large amount of resources to provoke this behavior in the naive manner.c|}|d|d}|d|}|dt |jD]K} |#t$r'}|jdttfvrYd}~nd}~wwxYw| d| | d|fdtf|tj|j}| |jdttfdS) z Test that the platform accept(2) call fails with either L{EMFILE} or L{ENOBUFS} when there are too many file descriptors open. ) 127.0.0.1rrFrNz7Could provoke neither EMFILE nor ENOBUFS from platform.r:)r5bind getsocknamelisten setblockingranger'OSErrorargsrrfailassertIn connect_exr assertRaiseserroraccept)r(portserverPortNumberclientieexcs r*test_acceptOutOfFilesz.PlatformAssumptionsTests.test_acceptOutOfFiles[sq{{}} "###++--a0 A5!!!t'(( Q QA     6!9 111EEEEE   IIO P P P   {,<= > >K@P    dk:: chqkFG#455555sB.. C8CCCN) __name__ __module__ __qualname____doc__r'r+r3r5rrgetTyperOr,r*rr)s K...$ Y Y Y Vg% 5 %6%6  %6%6%6r,rceZdZdZdZdZdZdZdZdZ dZ e e j d kd d Ze e j d kd d Ze ejddkddZe e j d kddZdZdS)SelectReactorTestsz7 Tests for select-specific failure conditions. c^g|_g|_tj|jjdSN)portsmessagesr addObserverr6r(s r*r+zSelectReactorTests.setUps+    ,-----r,cztj|jjt d|jDS)Nc6g|]}t|jSrU)r stopListening).0ps r* z/SelectReactorTests.tearDown..s"QQQmAO<<QQQr,)rremoveObserverr[r6rrZr]s r*r3zSelectReactorTests.tearDowns7 4=/000QQdjQQQRRRr,ct|||}||j||S)z Create, start, and return a new L{Port}, also tracking it so it can be stopped in the test tear down.  interface)rstartListeningrZr6)r( portNumberfactoryrgrbs r*rIzSelectReactorTests.portsE W : : :  !r,cGfdd}t}|d|d}||d||dtjfd|jD}|t|dd |jd S) a Test behavior in the face of an exception from C{accept(2)}. On any exception which indicates the platform is unable or unwilling to allocate further resources to us, the existing port should remain listening, a message should be logged, and the exception should not propagate outward from doRead. @param socketErrorNumber: The errno to simulate from accept. ceZdZdZfdZdS)9SelectReactorTests._acceptFailureTest..FakeSocketzI Pretend to be a socket in an overloaded system. cHttjrY)rAosstrerror)r(socketErrorNumbers r*rHz@SelectReactorTests._acceptFailureTest..FakeSocket.accepts/=N1O1OPPPr,NrPrQrRrSrH)rqsr* FakeSocketrms?   Q Q Q Q Q Q Qr,rsrr:rfr5z/Could not accept new connection ({acceptError})ctg|]4}|dko|dk5S) log_format acceptError)get)ramsgexpectedErrorCodeexpectedFormats r*rcz9SelectReactorTests._acceptFailureTest..sW    %%7@GGM**.??   r,z)Log event for failed accept not found in N) r rIpatchdoReaderrno errorcoder[ assertGreaterr")r(rqrsrjrImatchingMessagesryrzs ` @@r*_acceptFailureTestz%SelectReactorTests._acceptFailureTests Q Q Q Q Q Q Q Q Q Q //yyG{y;; 4::<<000 J!O,=>     }       ! ! A@D O     r,c6|tS)a* C{accept(2)} can fail with C{EMFILE} when there are too many open file descriptors in the process. Test that this doesn't negatively impact any other existing connections. C{EMFILE} mainly occurs on Linux when the open file rlimit is encountered. )rrr]s r*test_tooManyFilesFromAcceptz.SelectReactorTests.test_tooManyFilesFromAccept&&v...r,c6|tS)z Similar to L{test_tooManyFilesFromAccept}, but test the case where C{accept(2)} fails with C{ENOBUFS}. This mainly occurs on Windows and FreeBSD, but may be possible on Linux and other platforms as well. )rrr]s r*test_noBufferSpaceFromAcceptz/SelectReactorTests.test_noBufferSpaceFromAccepts&&w///r,c6|tS)z Similar to L{test_tooManyFilesFromAccept}, but test the case where C{accept(2)} fails with C{ECONNABORTED}. It is not clear whether this is actually possible for TCP connections on modern versions of Linux. )rr r]s r* test_connectionAbortedFromAcceptz3SelectReactorTests.test_connectionAbortedFromAccepts&&|444r,r8z(Windows accept(2) cannot generate ENFILEc6|tS)z Similar to L{test_tooManyFilesFromAccept}, but test the case where C{accept(2)} fails with C{ENFILE}. This can occur on Linux when the system has exhausted (!) its supply of inodes. )rrr]s r*test_noFilesFromAcceptz)SelectReactorTests.test_noFilesFromAcceptrr,z(Windows accept(2) cannot generate ENOMEMc6|tS)a Similar to L{test_tooManyFilesFromAccept}, but test the case where C{accept(2)} fails with C{ENOMEM}. On Linux at least, this can sensibly occur, even in a Python program (which eats memory like no ones business), when memory has become fragmented or low memory has been filled (d_alloc calls kmem_cache_alloc calls kmalloc - kmalloc only allocates out of low memory). )rrr]s r*test_noMemoryFromAcceptz*SelectReactorTests.test_noMemoryFromAccepts&&v...r,INFRASTRUCTUREAZUREPIPELINESz(Hangs on Azure Pipelines due to firewallct}t|_|d|d|jgfd}||fd}|d_| jd|| jd| jddS)z L{tcp.Port.doRead} increases the number of consecutive C{accept} calls it performs if all of the previous C{accept} calls succeed; otherwise, it reduces the number to the amount of successful calls. rr:rfc:D]}|dSrY)r/)rKclientss r*closeAllz7SelectReactorTests.test_acceptScaling..closeAlls+!     r,ctjtjtj}|djf|S)Nr:)r5AF_INET SOCK_STREAMconnectgetHostrI)rKrIs r*rz6SelectReactorTests.test_acceptScaling..connects@]6>63EFFF NNK)<= > > >Mr,rN) r rprotocolrI addCleanupr`r6 numberAcceptsr|r assertEqual)r(rjrrrrIs @@r*test_acceptScalingz%SelectReactorTests.test_acceptScalingsD //#yyG{y;; *+++      !!!      wwyy!!!  4-q111wwyy!!!  +Q///  +Q/////r,z'Windows accept(2) cannot generate EPERMcddgGfdd}tD]/}tj|j0j|jdgt }d|d}d|_ |d||  |jdd S) z C{accept(2)} returning C{EPERM} is treated as a transient failure and the call retried no more than the maximum number of consecutive C{accept(2)} calls. {rc"eZdZdZfdZdS)LSelectReactorTests.test_permissionFailure..FakeSocketWithAcceptLimit Pretend to be a socket in an overloaded system whose C{accept} method can only be called C{maximumNumberOfAccepts} times. cdxxdz cc<dkrdtttjt)Nrrz(Maximum number of accept calls exceeded.)rCrArrorp)oself acceptCallsmaximumNumberOfAcceptsr(s r*rHzSSelectReactorTests.test_permissionFailure..FakeSocketWithAcceptLimit.acceptCsVA!#q>$:::IIHIIIeR[%7%7888r,Nrr)rrr(sr*FakeSocketWithAcceptLimitr<sB    9 9 9 9 9 9 9 9 9r,rr:rfr5rN) r@rFr5rGrHfailureExceptionr rIrr{r| assertEquals)r(r_rjrIrrs` @@r*test_permissionFailurez)SelectReactorTests.test_permissionFailure2s9"%c  9 9 9 9 9 9 9 9 9 9 9 9-.. P PA   fl,E,E,G,G,N O O O O $/1J1J1L1L1STTTc //yyG{y;;  4#<#<#>#>???  $,a00000r,cbtt}|ttt gt d|DdzGfdd}t}|d|d}| |d|| | tj }|dt|||djjdd S) z} A C{socket.error} raised by C{accept(2)} whose C{errno} is unknown to the recovery logic is logged. c3DK|]}t|t|VdSrY) isinstanceint)rarGs r* zBSelectReactorTests.test_unknownSocketErrorRaise..gs1II%*UC2H2HIIIIIIIr,rceZdZdZfdZdS)YSelectReactorTests.test_unknownSocketErrorRaise..FakeSocketWithUnknownAcceptErrorrc$td)Nzunknown socket error message)rA)runknownAcceptErrors r*rHz`SelectReactorTests.test_unknownSocketErrorRaise..FakeSocketWithUnknownAcceptError.acceptqs02PQQQr,Nrr)rsr* FakeSocketWithUnknownAcceptErrorrjs?    R R R R R R Rr,rrr:rfr5N)listr extendr rrmaxr rIr{r|flushLoggedErrorsr5rGrr"valuerB)r( knownErrorsrrjrIfailuresrs @r*test_unknownSocketErrorRaisez/SelectReactorTests.test_unknownSocketErrorRaise^s; >** FE;7888 II;III I IA M  R R R R R R R R R R //yyG{y;; 4#C#C#E#EFFF ))&,77 CMM*** !*/24FGGGGGr,N)rPrQrRrSr+r3rIrrrrrrrTrrroenvironrwrrrrUr,r*rWrWs ... SSS' ' ' R / / /000555 V H   ' )+UVV//WV/ V H   ' )+UVV / /WV / V '((,<<2'0'0 '0R V H   ' )+TUU)1)1VU)1VHHHHHr,rW)'rSr}ror5r ImportErrorunittestrtwisted.internetrrtwisted.internet.deferrrtwisted.internet.protocolrr twisted.internet.tcpr r r r rrrrrrrtwisted.pythonrtwisted.python.runtimertwisted.trial.unittestr IReactorFDSet providedByrrWrUr,r*rs[  OOOOHHH00000000????????========                          ++++++++++++ ++G444EX6X6X6X6X6xX6X6 X6v ++G444EpHpHpHpHpHpHpH pHpHpHs