U ��.e��@s(dZddlmZddlZddlZddlmZddlmZddl m Zddlm Z mZmZmZddlmZdd lmZdd lmZddlmZddlmZdd lmZddlmZddlm Z ddl!m"Z"ddl#m$Z$ddl%m&Z&ddl'm(Z(ddl)m*Z*e$�r�ddl+m,Z,m-Z-m.Z.m/Z/m0Z0m1Z1m2Z2m3Z3ddl m4Z4ddl5m6Z6ddl7m8Z8ddl9m:Z:ddl;mZ>e3e2de2e?e@ffZAe2e?e?e?e4eAe/e?fZBdddgZCe�DeE�ZFd1d!d"�ZGGd#d$�d$eH�ZId%d&�ZJGd'd(�d(eH�ZKGd)d�deH�ZLGd*d+�d+eH�ZMGd,d�deH�ZNd-d.�ZOd/d0�ZPdS)2z!Routines related to PyPI, indexes�)�absolute_importN)� specifiers)�canonicalize_name)�parse)�BestVersionAlreadyInstalled�DistributionNotFound�InvalidWheelFilename�UnsupportedWheel)�InstallationCandidate)� FormatControl)�Link)�SelectionPreferences)�TargetPython)�WHEEL_EXTENSION)� indent_log)�build_netloc)�check_requires_python)�MYPY_CHECK_RUNNING)�SUPPORTED_EXTENSIONS)�url_to_path)�Wheel)� FrozenSet�Iterable�List�Optional�Set�Text�Tuple�Union)�_BaseVersion)� LinkCollector)�SearchScope)�InstallRequirement)� Pep425Tag)�Hashes�r�BestCandidateResult� PackageFinderFcCs~zt|j|d�}Wn&tjk r8t�d|j|�YnBX|szd�tt|��}|sht�d||j|�dSt�d||j|�dS)aa Return whether the given Python version is compatible with a link's "Requires-Python" value. :param version_info: A 3-tuple of ints representing the Python major-minor-micro version to check. :param ignore_requires_python: Whether to ignore the "Requires-Python" value if the given Python version isn't compatible. )�version_infoz2Ignoring invalid Requires-Python (%r) for link: %s�.z4Link requires a different Python (%s not in: %r): %sFzBIgnoring failed Requires-Python check (%s not in: %r) for link: %sT) rZrequires_pythonrZInvalidSpecifier�logger�debug�join�map�str)�linkr(�ignore_requires_pythonZ is_compatible�versionr%r%�7/usr/lib/python3.8/site-packages/pip/_internal/index.py�_check_link_requires_python;s8� � ��r3c@s,eZdZdZe�d�Zddd�Zdd�ZdS) � LinkEvaluatorzD Responsible for evaluating links for a particular project. z-py([123]\.?[0-9]?)$NcCs4|dkrd}||_||_||_||_||_||_dS)a� :param project_name: The user supplied package name. :param canonical_name: The canonical package name. :param formats: The formats allowed for this package. Should be a set with 'binary' or 'source' or both in it. :param target_python: The target Python interpreter to use when evaluating link compatibility. This is used, for example, to check wheel compatibility, as well as when checking the Python version, e.g. the Python version embedded in a link filename (or egg fragment) and against an HTML link's optional PEP 503 "data-requires-python" attribute. :param allow_yanked: Whether files marked as yanked (in the sense of PEP 592) are permitted to be candidates for install. :param ignore_requires_python: Whether to ignore incompatible PEP 503 "data-requires-python" values in HTML links. Defaults to False. NF)� _allow_yanked�_canonical_name�_ignore_requires_python�_formats�_target_python�project_name)�selfr:�canonical_name�formats� target_python�allow_yankedr0r%r%r2�__init__rszLinkEvaluator.__init__cCs�d}|jr(|js(|jpd}dd�|�fS|jr<|j}|j}n�|��\}}|sPdS|tkrddd|fSd|jkr�|t kr�d|j }d|fSd |jkr�|d kr�dS|t k�r,zt|j �}Wntk r�YdSXt|j�|jkr�d |j }d|fS|j��}|�|��s&|��}d�d�|��}d|fS|j}d|jk�rP|t k�rPdd|j fS|�sbt||j�}|�svdd|j fS|j�|�} | �r�|d| ��}| �d�} | |jjk�r�dSt||jj|j d�}|�s�dSt!�"d||�d|fS)aG Determine whether a link is a candidate for installation. :return: A tuple (is_candidate, result), where `result` is (1) a version string if `is_candidate` is True, and (2) if `is_candidate` is False, an optional string to log the reason the link fails to qualify. N�Fzyanked for reason: {})Fz not a filezunsupported archive format: %sZbinaryzNo binaries permitted for %sZmacosx10z.zip)Fzmacosx10 one)Fzinvalid wheel filenamezwrong project name (not %s)z"none of the wheel's tags match: {}�, �sourcezNo sources permitted for %szMissing project version for %s�)FzPython version is incorrect)r(r0)FNzFound link %s, version: %sT)#� is_yankedr5� yanked_reason�format�egg_fragment�ext�splitextrr8rr:�pathr�filenamerr�namer6r9�get_tags� supportedZget_formatted_file_tagsr,r1�_extract_version_from_fragment�_py_version_re�search�start�group� py_versionr3Zpy_version_infor7r*r+)r;r/r1�reasonZegg_inforI�wheel�supported_tagsZ file_tags�matchrUZsupports_pythonr%r%r2� evaluate_link�sx �� zLinkEvaluator.evaluate_link)N) �__name__� __module__�__qualname__�__doc__�re�compilerQr@rZr%r%r%r2r4fs � &r4c Cs�|st�dt|�|�t|�Sg}g}d}|D]>}|j}|js@n"|j|d�rV|d7}n|�|�q.|�|�q.|rx|}nt|�}t|�t|�kr�d} n d�t|�d� dd �|D��} t�d t|�||j |t|�|| �|S)a� Filter out candidates whose hashes aren't allowed, and return a new list of candidates. If at least one candidate has an allowed hash, then all candidates with either an allowed hash or no hash specified are returned. Otherwise, the given candidates are returned. Including the candidates with no hash specified when there is a match allows a warning to be logged if there is a more preferred candidate with no hash specified. Returning all candidates in the case of no matches lets pip report the hash of the candidate that would otherwise have been installed (e.g. permitting the user to more easily update their requirements file with the desired hash). zJGiven no hashes to check %s links for project %r: discarding no candidatesr)�hashesrDzdiscarding no candidateszdiscarding {} non-matches: {}z css|]}t|j�VqdS�N)r.r/��.0� candidater%r%r2� +sz*filter_unallowed_hashes..zPChecked %s links for project %r against %s hashes (%s matches, %s no digest): %s)r*r+�len�listr/Zhas_hash�is_hash_allowed�appendrGr,Zdigest_count) � candidatesrar:Zmatches_or_no_digestZnon_matchesZmatch_countrer/ZfilteredZdiscard_messager%r%r2�filter_unallowed_hashes�sL� � �rlc@seZdZdZddd�ZdS)�CandidatePreferenceszk Encapsulates some of the preferences for filtering and sorting InstallationCandidate objects. FcCs||_||_dS)zR :param allow_all_prereleases: Whether to allow all pre-releases. N)�allow_all_prereleases� prefer_binary)r;rornr%r%r2r@Cs zCandidatePreferences.__init__N)FF)r[r\r]r^r@r%r%r%r2rm<s�rmc@s(eZdZdZdd�Zdd�Zdd�ZdS) r&z�A collection of candidates, returned by `PackageFinder.find_best_candidate`. This class is only intended to be instantiated by CandidateEvaluator's `compute_best_candidate()` method. cCs |dkr n||_||_||_dS)a :param candidates: A sequence of all available candidates found. :param applicable_candidates: The applicable candidates. :param best_candidate: The most preferred candidate found, or None if no applicable candidates were found. N)�_applicable_candidates�_candidates�best_candidate�r;rk�applicable_candidatesrrr%r%r2r@Ws zBestCandidateResult.__init__cCs t|j�S)z(Iterate through all candidates. )�iterrq�r;r%r%r2�iter_allpszBestCandidateResult.iter_allcCs t|j�S)z3Iterate through the applicable candidates. )rurprvr%r%r2�iter_applicablevsz#BestCandidateResult.iter_applicableN)r[r\r]r^r@rwrxr%r%r%r2r&Psc@sHeZdZdZeddd��Zddd�Zdd �Zd d�Zdd �Z dd�Z dS)�CandidateEvaluatorzm Responsible for filtering and sorting candidates for installation based on what tags are valid. NFcCs:|dkrt�}|dkrt��}|��}|||||||d�S)a�Create a CandidateEvaluator object. :param target_python: The target Python interpreter to use when checking compatibility. If None (the default), a TargetPython object will be constructed from the running Python. :param specifier: An optional object implementing `filter` (e.g. `packaging.specifiers.SpecifierSet`) to filter applicable versions. :param hashes: An optional collection of allowed hashes. N)r:rX� specifierrornra)rrZSpecifierSetrN)�clsr:r>rornrzrarXr%r%r2�create�s�zCandidateEvaluator.createcCs(||_||_||_||_||_||_dS)z� :param supported_tags: The PEP 425 tags supported by the target Python in order of preference (most preferred first). N)�_allow_all_prereleases�_hashes�_prefer_binary� _project_name� _specifier�_supported_tags)r;r:rXrzrornrar%r%r2r@�szCandidateEvaluator.__init__csV|jpd}|j}dd�|jdd�|D�|d�D��fdd�|D�}t||j|jd �S) zM Return the applicable candidates from a list of candidates. NcSsh|]}t|��qSr%)r.)rd�vr%r%r2� �sz?CandidateEvaluator.get_applicable_candidates..css|]}t|j�VqdSrb�r.r1�rd�cr%r%r2rf�sz?CandidateEvaluator.get_applicable_candidates..)Zprereleasescsg|]}t|j��kr|�qSr%r�r��Zversionsr%r2� �s[email protected]_applicable_candidates..)rkrar:)r}r��filterrlr~r�)r;rkZallow_prereleasesrzrtr%r�r2�get_applicable_candidates�s �� z,CandidateEvaluator.get_applicable_candidatesc Cs�|j}t|�}d}d}|j}|jr�t|j�}|�|�sDtd|j��|jrNd}|� |�}|j dk r�t�d|j �} | � �} t| d�| df}n|}t|�|j��}dt|j�}||||j||fS)a) Function to pass as the `key` argument to a call to sorted() to sort InstallationCandidates by preference. Returns a tuple such that tuples sorting as greater using Python's default comparison operator are more preferred. The preference is as follows: First and foremost, candidates with allowed (matching) hashes are always preferred over candidates without matching hashes. This is because e.g. if the only candidate with an allowed hash is yanked, we still want to use that candidate. Second, excepting hash considerations, candidates that have been yanked (in the sense of PEP 592) are always less preferred than candidates that haven't been yanked. Then: If not finding wheels, they are sorted by version only. If finding wheels, then the sort order is by version, then: 1. existing installs 2. wheels ordered via Wheel.support_index_min(self._supported_tags) 3. source archives If prefer_binary was set, then all wheels are sorted above sources. Note: it was considered to embed this logic into the Link comparison operators, but then different sdist links with the same version, would have to be considered equal r%rzB%s is not a supported wheel for this platform. It can't be sorted.rDNz^(\d+)(.*)$��)r�rgr/Zis_wheelrrLrOr rZsupport_index_min� build_tagr_rY�groups�intrir~rEr1) r;reZ valid_tagsZsupport_numr�Zbinary_preferencer/rWZprirYZbuild_tag_groupsZhas_allowed_hashZ yank_valuer%r%r2� _sort_key�s< �� zCandidateEvaluator._sort_keycCsH|sdSt||jd�}|j}|jrD|jp*d}dj||d�}t�|�|S)zy Return the best candidate per the instance's sort order, or None if no candidate is acceptable. N��keyrAzqThe candidate selected for download or install is a yanked version: {candidate} Reason for being yanked: {reason})rerV)�maxr�r/rErFrGr*Zwarning)r;rkrrr/rV�msgr%r%r2�sort_best_candidates �� z&CandidateEvaluator.sort_best_candidatecCs"|�|�}|�|�}t|||d�S)zF Compute and return a `BestCandidateResult` instance. )rtrr)r�r�r&rsr%r%r2�compute_best_candidate<s �z)CandidateEvaluator.compute_best_candidate)NFFNN)FFN)r[r\r]r^�classmethodr|r@r�r�r�r�r%r%r%r2ry}s �)� $<ryc@s�eZdZdZd&dd�Zed'dd��Zedd��Zej d d��Zed d��Z edd ��Zedd��Zedd��Z dd�Zdd�Zdd�Zdd�Zdd�Zdd�Zdd�Zd(d d!�Zd)d"d#�Zd$d%�ZdS)*r'z�This finds packages. This is meant to match easy_install's technique for looking for packages, by reading pages and looking for appropriate links. NcCsP|dkrt�}|ptt�t��}||_||_||_||_||_||_t�|_ dS)a� This constructor is primarily meant to be used by the create() class method and from tests. :param format_control: A FormatControl object, used to control the selection of source packages / binary packages when consulting the index and links. :param candidate_prefs: Options to use when creating a CandidateEvaluator object. N) rmr�setr5�_candidate_prefsr7�_link_collectorr9�format_control� _logged_links)r;�link_collectorr>r?r��candidate_prefsr0r%r%r2r@VszPackageFinder.__init__cCs8|dkrt�}t|j|jd�}|||||j|j|jd�S)afCreate a PackageFinder. :param selection_prefs: The candidate selection preferences, as a SelectionPreferences object. :param target_python: The target Python interpreter to use when checking compatibility. If None (the default), a TargetPython object will be constructed from the running Python. N)rorn)r�r�r>r?r�r0)rrmrornr?r�r0)r{r�Zselection_prefsr>r�r%r%r2r|~s��zPackageFinder.createcCs|jjSrb�r��search_scopervr%r%r2r��szPackageFinder.search_scopecCs||j_dSrbr�)r;r�r%r%r2r��scCs|jjSrb)r�� find_linksrvr%r%r2r��szPackageFinder.find_linkscCs|jjSrb)r�� index_urlsrvr%r%r2r��szPackageFinder.index_urlsccs|jjjD]}t|�Vq dSrb)r�ZsessionZpip_trusted_originsr)r;Z host_portr%r%r2� trusted_hosts�szPackageFinder.trusted_hostscCs|jjSrb�r�rnrvr%r%r2rn�sz#PackageFinder.allow_all_prereleasescCsd|j_dS)NTr�rvr%r%r2�set_allow_all_prereleases�sz'PackageFinder.set_allow_all_prereleasescCs.t|�}|j�|�}t||||j|j|jd�S)N)r:r<r=r>r?r0)rr�Zget_allowed_formatsr4r9r5r7)r;r:r<r=r%r%r2�make_link_evaluator�s�z!PackageFinder.make_link_evaluatorcCsPgg}}t�}|D]2}||kr|�|�|jr<|�|�q|�|�q||S)z� Returns elements of links in order, non-egg links first, egg links second, while eliminating duplicates )r��addrHrj)r;�linksZeggsZno_eggs�seenr/r%r%r2�_sort_links�s zPackageFinder._sort_linkscCs(||jkr$t�d||�|j�|�dS)NzSkipping link: %s: %s)r�r*r+r�)r;r/rVr%r%r2�_log_skipped_link�s zPackageFinder._log_skipped_linkcCs<|�|�\}}|s(|r$|j||d�dSt|j|t|�d�S)z� If the link is a candidate for install, convert it to an InstallationCandidate and return it. Otherwise, return None. )rVN)Zprojectr/r1)rZr�r r:r.)r;�link_evaluatorr/Zis_candidate�resultr%r%r2�get_install_candidate�s�z#PackageFinder.get_install_candidatecCs6g}|�|�D]"}|�||�}|dk r|�|�q|S)zU Convert links that are candidates to InstallationCandidate objects. N)r�r�rj)r;r�r�rkr/rer%r%r2�evaluate_linksszPackageFinder.evaluate_linksc Cs�|j�|�}|�|�}|j||jd�}g}|j��D]>\}}t�d|�t ��|j||d�}|� |�W5QRXq4|j||jd�} | r�| jdd�t�dd� dd�| D��| ||S) aFind all available InstallationCandidate for project_name This checks index_urls and find_links. All versions found are returned as an InstallationCandidate list. See LinkEvaluator.evaluate_link() for details on which files are accepted. )r�zAnalyzing links from page %sT)�reversezLocal files found: %srBcSsg|]}t|jj��qSr%)rr/Zurlrcr%r%r2r�2s�z5PackageFinder.find_all_candidates..)r�Z collect_linksr�r�r�Zpages�itemsr*r+r�extend�files�sortr,) r;r:Zcollected_linksr�Zfind_links_versionsZ page_versionsZpage_urlZ page_linksZnew_versionsZ file_versionsr%r%r2�find_all_candidates s8 �� z!PackageFinder.find_all_candidatescCs"|j}tj||j|j|j||d�S)z3Create a CandidateEvaluator object to use. )r:r>rornrzra)r�ryr|r9rorn)r;r:rzrar�r%r%r2�make_candidate_evaluator;s �z&PackageFinder.make_candidate_evaluatorcCs$|�|�}|j|||d�}|�|�S)aFind matches for the given project and specifier. :param specifier: An optional object implementing `filter` (e.g. `packaging.specifiers.SpecifierSet`) to filter applicable versions. :return: A `BestCandidateResult` instance. )r:rzra)r�r�r�)r;r:rzrarkZcandidate_evaluatorr%r%r2�find_best_candidateNs �z!PackageFinder.find_best_candidatec Cs|jdd�}|j|j|j|d�}|j}d}|jdk r@t|jj�}dd�}|dkrz|dkrzt� d|||� ��td|��d}|r�|dks�|j|kr�d }|s�|dk r�|r�t�d |�nt�d||j�dS|r�t�d|||� ��t�t�d |j||� ��|jS)z�Try to find a Link matching req Expects req, an InstallRequirement and upgrade, a boolean Returns a Link if found, Raises DistributionNotFound or BestVersionAlreadyInstalled otherwise F)Ztrust_internet)rzraNcSs d�tdd�|D�td��pdS)NrBcSsh|]}t|j��qSr%r�r�r%r%r2r�}szKPackageFinder.find_requirement.._format_versions..r�Znone)r,�sorted� parse_version)Z cand_iterr%r%r2�_format_versionsws��z8PackageFinder.find_requirement.._format_versionszNCould not find a version that satisfies the requirement %s (from versions: %s)z%No matching distribution found for %sTzLExisting installed version (%s) is most up-to-date and satisfies requirementzUExisting installed version (%s) satisfies requirement (most up-to-date version is %s)z=Installed version (%s) is most up-to-date (past versions: %s)z)Using version %s (newest of versions: %s))rar�rMrzrrZsatisfied_byr�r1r*Zcriticalrwrr+rxrr/) r;ZreqZupgraderaZbest_candidate_resultrrZinstalled_versionr�Zbest_installedr%r%r2�find_requirementesh� �� zPackageFinder.find_requirement)NNN)N)NN)NN)r[r\r]r^r@r�r|�propertyr��setterr�r�r�rnr�r�r�r�r�r�r�r�r�r�r%r%r%r2r'OsD� (� 1� � cCsLt|�D].\}}|dkrqt|d|��|kr|Sqtd�||��dS)a�Find the separator's index based on the package's canonical name. :param fragment: A + filename "fragment" (stem) or egg fragment. :param canonical_name: The package's canonical name. This function is needed since the canonicalized name does not necessarily have the same length as the egg info's name part. An example:: >>> fragment = 'foo__bar-1.0' >>> canonical_name = 'foo-bar' >>> _find_name_version_sep(fragment, canonical_name) 8 �-Nz{} does not match {})� enumerater� ValueErrorrG)�fragmentr<�ir�r%r%r2�_find_name_version_sep�s r�cCsBzt||�d}Wntk r(YdSX||d�}|s>dS|S)z�Parse the version string from a + filename "fragment" (stem) or egg fragment. :param fragment: The string to parse. E.g. foo-2.1 :param canonical_name: The canonicalized name of the package this belongs to. rDN)r�r�)r�r<Z version_startr1r%r%r2rP�s rP)F)Qr^Z __future__rZloggingr_Zpip._vendor.packagingrZpip._vendor.packaging.utilsrZpip._vendor.packaging.versionrr�Zpip._internal.exceptionsrrrr Zpip._internal.models.candidater Z#pip._internal.models.format_controlrZpip._internal.models.linkrZ$pip._internal.models.selection_prefsr Z"pip._internal.models.target_pythonrZpip._internal.utils.filetypesrZpip._internal.utils.loggingrZpip._internal.utils.miscrZpip._internal.utils.packagingrZpip._internal.utils.typingrZpip._internal.utils.unpackingrZpip._internal.utils.urlsrZpip._internal.wheelr�typingrrrrrrrrrZpip._internal.collectorr Z!pip._internal.models.search_scoper!Zpip._internal.reqr"Zpip._internal.pep425tagsr#Zpip._internal.utils.hashesr$r�r.ZBuildTagZCandidateSortingKey�__all__Z getLoggerr[r*r3�objectr4rlrmr&ryr'r�rPr%r%r%r2�s^(� � +K-Sh