'i?SrSSKJr SSKrSSKrSSKrSSKrSSKrSSK r SSK r SSK r SSK JrJrJr SSKJr SSKJr SSKJr SSKJrJrJr SS KJr SS KJr SS KJ r J!r! SS K"J#r# SS K$J%r% SSK&J'r' SSK(J)r) SSK*J+r+ SSK,J-r- SSK.J/r/ SSK0J1r1 SSK2J3r3 SSK4J5r5J6r6J7r7 \ Rp"\95r:\\;\;4r5r?S4Sjr@"SS\>5rAS5SjrBS6SjrCS7SjrD"S S!5rE"S"S#\5rFS8S$jrG\GS9S&j5rH\"S'S(9"S)S%55rI"S*S+\5rJS:S;S,jjrKS<S=S-jjrLS>S.jrM"S/S0\5rN"S1S25rOg)?zO The main purpose of this module is to expose LinkCollector.collect_sources(). ) annotationsN)IterableMutableMappingSequence) dataclass) HTMLParser)Values)Callable NamedTupleProtocol)requests)Response) RetryErrorSSLError)NetworkConnectionError)Link) SearchScope) PipSession)raise_for_status)is_archive_fileredact_auth_from_url) url_to_path)vcs)CandidatesFromPage LinkSource build_sourcec[RH?nUR5RU5(dM)U[ U5S;dM=Us $ g)z_Look for VCS schemes in the URL. Returns the matched VCS scheme, or None if there's no match. z+:N)rschemeslower startswithlen)urlschemes \/var/www/surfInsights/venv3-11/lib/python3.13/site-packages/pip/_internal/index/collector.py_match_vcs_schemer'.sC ++ 99; ! !& ) )c#f+.>$.FM c,^\rSrSrSU4SjjrSrU=r$)_NotAPIContent9c<>[TU]X5 XlX lgN)super__init__ content_type request_desc)selfr0r1 __class__s r&r/_NotAPIContent.__init__:s 4((r()r0r1)r0strr1r5returnNone)__name__ __module__ __qualname____firstlineno__r/__static_attributes__ __classcell__r3s@r&r*r*9s ))r(r*cURRSS5nUR5nURS5(ag[ XR R 5e)z Check the Content-Type header to ensure the response contains a Simple API Response. Raises `_NotAPIContent` if the content type is not a valid content-type. Content-TypeUnknown)z text/htmlz#application/vnd.pypi.simple.v1+html#application/vnd.pypi.simple.v1+jsonN)headersgetr!r"r*requestmethod)responser0content_type_ls r&_ensure_api_headerrI@s^##'' BL!'')N     '7'7'>'> ??r(c\rSrSrSrg)_NotHTTPVN)r8r9r:r;r<rMr(r&rKrKVsr(rKc[RRU5up#pEnUS;a [5eUR USS9n[ U5 [ U5 g)z Send a HEAD request to the URL, and ensure the response contains a simple API Response. Raises `_NotHTTP` if the URL is not available for a HEAD request, or `_NotAPIContent` if the content type is not a valid content type. >httphttpsT)allow_redirectsN)urllibparseurlsplitrKheadrrI)r$sessionr%netlocpathqueryfragmentresps r&_ensure_api_responser\ZsR-3LL,A,A#,F)FD &&j <<T< 2DTtr(c[[U5R5(a [XS9 [R S[ U55 URUSR/SQ5SS.S9n[U5 [U5 [R S[ U5URRS S 55 U$) a5Access an Simple API response with GET, and return the response. This consists of three parts: 1. If the URL looks suspiciously like an archive, send a HEAD first to check the Content-Type is HTML or Simple API, to avoid downloading a large file. Raise `_NotHTTP` if the content type cannot be determined, or `_NotAPIContent` if it is not HTML or a Simple API. 2. Actually perform the request. Raise HTTP exceptions on network failures. 3. Check the Content-Type header to make sure we got a Simple API response, and raise `_NotAPIContent` otherwise. rVzGetting page %sz, )rBz*application/vnd.pypi.simple.v1+html; q=0.1ztext/html; q=0.01z max-age=0)Acceptz Cache-Control)rCzFetched page %s as %sr@rA) rrfilenamer\loggerdebugrrDjoinrrIrC)r$rVr[s r&_get_simple_responserdlstCy))**S2 LL"$8$=> ;; ii()+   D4Tt LLS! 3 Kr(cU(aOSU;aI[RR5nUSUS'URS5nU(a [ U5$g)z=Determine if we have any encoding information in our headers.r@z content-typecharsetN)emailmessageMessage get_paramr5)rCmrfs r&_get_encoding_from_headersrlsK>W, MM ! ! ##N3.++i( w<  r(c2\rSrSrSSjrSSjrS SjrSrg) CacheablePageContentc6UR(deXlgr-)cache_link_parsingpager2rrs r&r/CacheablePageContent.__init__s&&&& r(c[U[U55=(a- URRURR:H$r-) isinstancetyperrr$)r2others r&__eq__CacheablePageContent.__eq__s-%d,P%**..1PPr(c@[URR5$r-)hashrrr$r2s r&__hash__CacheablePageContent.__hash__sDIIMM""r()rrN)rr IndexContentr6r7)rxobjectr6bool)r6int)r8r9r:r;r/ryr~r<rMr(r&rnrnsQ#r(rnc\rSrSrSSjrSrg) ParseLinkscgr-rMrss r&__call__ParseLinks.__call__scr(rMNrrrr6zIterable[Link])r8r9r:r;rr<rMr(r&rrsAr(rc^^[RSU4Sjj5m[R"T5SUU4Sjj5nU$)z Given a function that parses an Iterable[Link] from an IndexContent, cache the function's result (keyed by CacheablePageContent), unless the IndexContent `page` has `page.cache_link_parsing == False`. c:>[T"UR55$r-)listrr)cacheable_pagefns r&wrapper*with_cached_index_content..wrappersB~**+,,r(cj>UR(aT"[U55$[T"U55$r-)rqrnr)rrrrs r&wrapper_wrapper2with_cached_index_content..wrapper_wrappers+  " "/56 6BtH~r()rrnr6 list[Link])rrrr6r) functoolscachewraps)rrrs` @r&with_cached_index_contentrs@__--__R r(rc#~# URR5nURS5(ac[R"UR 5nUR S/5H,n[R"X0R5nUcM(Uv M. g[UR5nUR=(d SnURUR RU55 URnUR=(d UnURH!n [R "XUS9nUcMUv M# g7f)zT Parse a Simple API's Index Content, and yield its anchor elements as Link objects. rBfilesNzutf-8)page_urlbase_url)r0r!r"jsonloadscontentrDr from_jsonr$HTMLLinkParserencodingfeeddecoderanchors from_element) rrrHdatafilelinkparserrr$ranchors r& parse_linksrs &&,,.N  !FGGzz$,,'HHWb)D>>$1D|J *  DHH %F}}'H KK ##H-. ((C%#H..  I <  !sD;D=T)frozencZ\rSrSr%SrS\S'S\S'S\S'S\S 'S rS \S 'SS jrSrg)ratRepresents one response (or page), along with its URL. :param encoding: the encoding to decode the given content. :param url: the URL from which the HTML was downloaded. :param cache_link_parsing: whether links parsed from this page's url should be cached. PyPI index urls should have this set to False, for example. bytesrr5r0 str | Nonerr$Trrqc,[UR5$r-)rr$r}s r&__str__IndexContent.__str__s#DHH--r(rMN)r6r5) r8r9r:r;__doc____annotations__rqrr<rMr(r&rrs/N H##.r(cD^\rSrSrSrSU4SjjrSSjrS SjrSrU=r $) ri zZ HTMLParser that keeps the first base HREF and a list of all anchor elements' attributes. cH>[TU]SS9 XlSUl/Ulg)NT)convert_charrefs)r.r/r$rr)r2r$r3s r&r/HTMLLinkParser.__init__s& $/$( 46 r(cUS:Xa)URcURU5nUbX0lggUS:Xa%URR[ U55 gg)Nbasea)rget_hrefrappenddict)r2tagattrshrefs r&handle_starttagHTMLLinkParser.handle_starttagsR &=T]]2=='D $  CZ LL  U ,r(c.UHup#US:XdM Us $ g)NrrM)r2rnamevalues r&rHTMLLinkParser.get_href!s KDv~ !r()rrr$)r$r5r6r7)rr5rlist[tuple[str, str | None]]r6r7)rrr6r) r8r9r:r;rr/rrr<r=r>s@r&rr s 7-r(rc<Uc[RnU"SX5 g)Nz%Could not fetch URL %s: %s - skipping)rarb)rreasonmeths r&_handle_get_simple_failr(s  ||| 0$?r(c[UR5n[URURSUURUS9$)Nr@)rr$rq)rlrCrrr$)rGrqrs r&_make_index_contentr2sE*(*:*:;H ( LL-  r(c>URRSS5Sn[U5nU(a[R SUU5 gUR S5(a~[ RR[U55(aQURS5(dUS- n[RRUS5n[RSU5 [X!S 9n[!X@R"S 9$![$a [R S U5 g[&a6n[R S UUR(UR*5 SnAgSnAf[,an[/X5 SnAgSnAf[0an[/X5 SnAgSnAf[2a2nS nU[5U5- n[/X[R6S9 SnAgSnAf[8R:an[/USU35 SnAgSnAf[8R<a [/US5 gf=f)N#rrzICannot look at %s URL %s because it does not support lookup as web pages.zfile:/z index.htmlz# file: URL is directory, getting %sr^)rqz`Skipping page %s because it looks like an archive, and cannot be checked by a HTTP HEAD request.zSkipping page %s because the %s request got Content-Type: %s. The only supported Content-Types are application/vnd.pypi.simple.v1+json, application/vnd.pypi.simple.v1+html, and text/htmlz4There was a problem confirming the ssl certificate: )rzconnection error: z timed out)r$splitr'rawarningr"osrXisdirrendswithrRrSurljoinrbrdrrqrKr*r1r0rrrrr5infor ConnectionErrorTimeout)rrVr$ vcs_schemer[excrs r&_get_index_contentr?s ((..a  #C#3'J W    ~~g277==S1A#B#B||C  3JC ll""3 5 :C@U#C9:#4'LinkCollector.create..sIjs-c22js)rrno_index)rVr) index_urlextra_index_urlsrrarbrcrrcreater)clsrVoptionssuppress_no_indexrrrlink_collectors r&rLinkCollector.creates''(7+C+CC   $5 LL&IjII J''-2 "))!!%% '% r(c.URR$r-)rrr}s r&rLinkCollector.find_linkss  +++r(c([XRS9$)z. Fetch an HTML page containing package links. r^)rrV)r2locations r&fetch_responseLinkCollector.fetch_responses"(LLAAr(c^^^[R"UUU4SjTRRT555R 5n[R"UUU4SjTR 55R 5n[ R[R5(a[R"XC5Vs/sH&nUcMURcMSUR3PM( nn[U5STS3/U-n[ RSRU55 [![#U5[#U5S9$s snf)Nc 3h># UH'n[UTTRRSSTS9v M) g7f)Fcandidates_from_pagepage_validator expand_dirrq project_nameNrrVis_secure_originrlocrrr2s r&r0LinkCollector.collect_sources..s? 4 P %9#||<< #()  P/2c 3h># UH'n[UTTRRSSTS9v M) g7f)TrNrr s r&rr s= 5 ' %9#||<<#')  'r z* z' location(s) to search for versions of : )rr) collections OrderedDictrget_index_urls_locationsvaluesrra isEnabledForloggingDEBUG itertoolschainrr#rbrcrr)r2rrindex_url_sourcesfind_links_sourcessliness``` r&collect_sourcesLinkCollector.collect_sourcess8 (33 4 ((AA,O 4   &( )44 5  5   &(    w}} - -#);OOA%&VV"QVVH O  u:,##/.3E LL5) *./-.  sE  E !E rN)rVrrrr6r7)F)rVrrr rrr6r)r6z list[str])rrr6IndexContent | None)rr5rrr6r) r8r9r:r;rr/ classmethodrpropertyrrrr<rMr(r&rrs"   #(    B,,B , , 1,   , r(r)r$r5r6r)rGrr6r7)r$r5rVrr6r7)r$r5rVrr6r)rCResponseHeadersr6r)rrr6rrr-)rrrzstr | ExceptionrzCallable[..., None] | Noner6r7)T)rGrrqrr6r)rrrVrr6r)Pr __future__rr email.messagergrrrrr urllib.parserRcollections.abcrrr dataclassesr html.parserroptparser typingr r r pip._vendorr pip._vendor.requestsrpip._vendor.requests.exceptionsrrpip._internal.exceptionsrpip._internal.models.linkr!pip._internal.models.search_scoperpip._internal.network.sessionrpip._internal.network.utilsrpip._internal.utils.filetypesrpip._internal.utils.miscrpip._internal.utils.urlsrpip._internal.vcsrsourcesrrr getLoggerr8rar5r"r' Exceptionr*rIrKr\rdrlrnrrrrrrrrrrrMr(r&r:s#  >>!" !)@;*948990!AA   8 $ c*)Y)@, y $<~ # #BB(8 $...(Z>(,@ @ @ %@ @48  ,0  9x,z, h h r(