U
��.e_� � @ sD d dl Z d dlmZ d dlZd dlZd dlZd dlZd dlZz d dlZW n e k
rd d dl
ZY nX d dl Z ddl m
Z
ddlmZmZmZmZmZmZmZmZmZmZmZmZm Z m Z m Z ddl m Z m!Z!m"Z" ddl#m$Z$m%Z% ddl&m'Z'm(Z(m)Z)m*Z*m+Z+m,Z,m-Z-m.Z.m/Z/ dd l0m1Z1m2Z2 dd
l3m4Z4m5Z5 e�6e7�Z8e�9d �Z:e�9d ej;�Zd-dd�Z?G dd� de�Z@G dd� deA�ZBG dd� deB�ZCG dd� deB�ZDG dd� deA�ZEG dd � d eB�ZFG d d � d eB�ZGG d d � d eB�ZHG d!d"� d"eB�ZIG d#d$� d$eB�ZJeJeH� eFd%d&d'�d(d)�ZKeKjLZLe�9d*�ZMG d+d,� d,eA�ZNdS ).� N)�BytesIO� )�DistlibException)�urljoin�urlparse�
urlunparse� url2pathname� pathname2url�queue�quote�unescape� string_types� build_opener�HTTPRedirectHandler� text_type�Request� HTTPError�URLError)� Distribution�DistributionPath� make_dist)�Metadata�MetadataInvalidError) �cached_property�parse_credentials� ensure_slash�split_filename�get_project_data�parse_requirement�parse_name_and_version� ServerProxy�normalize_name)�
get_scheme�UnsupportedVersionError)�Wheel�
is_compatiblez^(\w+)=([a-f0-9]+)z;\s*charset\s*=\s*(.*)\s*$z text/html|application/x(ht)?mlzhttps://pypi.org/pypic C s6 | dkr t } t| dd�}z |�� W �S |d�� X dS )z�
Return all distribution names known by an index.
:param url: The URL of the index.
:return: A list of all known distribution names.
N� @��timeout�close)�
DEFAULT_INDEXr �
list_packages)�url�client� r. �@/usr/lib/python3.8/site-packages/pip/_vendor/distlib/locators.py�get_all_distribution_names) s r0 c @ s$ e Zd ZdZdd� Ze Z ZZdS )�RedirectHandlerzE
A class to work around a bug in some Python 3.2.x releases.
c C s� d }dD ]}||kr|| } q"q|d kr.d S t |�}|jdkrnt|�� |�}t|d�rf|�||� n|||< t�| |||||�S )N)�locationZuri� �replace_header)r �schemer Z get_full_url�hasattrr4 �BaseRedirectHandler�http_error_302) �self�req�fp�code�msg�headersZnewurl�keyZurlpartsr. r. r/ r8 @ s
�z RedirectHandler.http_error_302N)�__name__�
__module__� __qualname__�__doc__r8 Zhttp_error_301Zhttp_error_303Zhttp_error_307r. r. r. r/ r1 7 s r1 c @ s� e Zd ZdZdZdZdZdZed Zd)dd �Z d
d � Z
d d
� Z dd� Z dd� Z
dd� Zee
e�Zdd� Zdd� Zdd� Zdd� Zd d � Zd d � Zd d!� Zd"d#� Zd$d%� Zd*d'd(�ZdS )+�LocatorzG
A base class for locators - things that locate distributions.
)z.tar.gzz.tar.bz2z.tarz.zipz.tgzz.tbz)z.eggz.exe�.whl)z.pdfN)rE �defaultc C s, i | _ || _tt� �| _d| _t�� | _dS )a^
Initialise an instance.
:param scheme: Because locators look for most recent versions, they
need to know the version scheme to use. This specifies
the current PEP-recommended scheme - use ``'legacy'``
if you need to support existing distributions on PyPI.
N) �_cacher5 r r1 �opener�matcherr
�Queue�errors)r9 r5 r. r. r/ �__init__f s
zLocator.__init__c C sV g }| j �� sRz| j �d�}|�|� W n | j jk
rD Y qY nX | j �� q|S )z8
Return any errors which have occurred.
F)rK �empty�get�appendZEmpty� task_done)r9 �result�er. r. r/ �
get_errorsy s
zLocator.get_errorsc C s | � � dS )z>
Clear any errors which may have been logged.
N)rS �r9 r. r. r/ � clear_errors� s zLocator.clear_errorsc C s | j �� d S �N)rG �clearrT r. r. r/ � clear_cache� s zLocator.clear_cachec C s | j S rV ��_schemerT r. r. r/ � _get_scheme� s zLocator._get_schemec C s
|| _ d S rV rY )r9 �valuer. r. r/ � _set_scheme� s zLocator._set_schemec C s t d��dS )a=
For a given project, get a dictionary mapping available versions to Distribution
instances.
This should be implemented in subclasses.
If called from a locate() request, self.matcher will be set to a
matcher for the requirement to satisfy, otherwise it will be None.
� Please implement in the subclassN��NotImplementedError)r9 �namer. r. r/ � _get_project� s
zLocator._get_projectc C s t d��dS )�J
Return all the distribution names known to this locator.
r^ Nr_ rT r. r. r/ �get_distribution_names� s z Locator.get_distribution_namesc C sL | j dkr| �|�}n2|| j kr,| j | }n | �� | �|�}|| j |< |S )z�
For a given project, get a dictionary mapping available versions to Distribution
instances.
This calls _get_project to do all the work, and just implements a caching layer on top.
N)rG rb rU )r9 ra rQ r. r. r/ � get_project� s
zLocator.get_projectc C s^ t |�}t�|j�}d}|�d�}|�| j�}|rBtt|�| j�}|j dkd|j
k||||fS )zu
Give an url a score which can be used to choose preferred URLs
for a given project release.
TrE �httpszpypi.org) r � posixpath�basename�path�endswith�downloadable_extensionsr% r$ �
wheel_tagsr5 �netloc)r9 r, �trh Z
compatibleZis_wheelZis_downloadabler. r. r/ � score_url� s
�zLocator.score_urlc C sR |}|rN| � |�}| � |�}||kr(|}||kr@t�d||� nt�d||� |S )a{
Choose one of two URLs where both are candidates for distribution
archives for the same version of a distribution (for example,
.tar.gz vs. zip).
The current implementation favours https:// URLs over http://, archives
from PyPI over those from other locations, wheel compatibility (if a
wheel) and then the archive name.
zNot replacing %r with %rzReplacing %r with %r)ro �logger�debug)r9 �url1�url2rQ �s1�s2r. r. r/ �
prefer_url� s
zLocator.prefer_urlc C s
t ||�S )zZ
Attempt to split a filename in project name, version and Python version.
)r )r9 �filename� project_namer. r. r/ r � s zLocator.split_filenamec C s dd� }d}t |�\}}}}} }
|
�� �d�rz~t |�}t
|| j �s�t�d
|� nX|dkr�d }n ||j |�}|�r|j |j
|jt||||| d f�d
�dd� |jD ��d�}W n0 tk
�r: } zt�d|� W 5 d}~X Y nX n�|�| j��sZt�d|� n�t�|� }}| jD ]�}|�|��rn|dt|� � }| �||�}|�s�t�d|� nH|\}}}|�r�|||��r�|||t||||| d f�d�}|�r�||d< �q�qn|�r| �r|
|d| < |S )a
See if a URL is a candidate for a download URL for a project (the URL
has typically been scraped from an HTML page).
If it is, a dictionary is returned with keys "name", "version",
"filename" and "url"; otherwise, None is returned.
c S s t | �t |�kS rV )r! )Zname1Zname2r. r. r/ � same_project� s z:Locator.convert_url_to_download_info..same_projectNzegg=z %s: version hint in fragment: %r)NN������/rE zWheel not compatible: %sTr3 z, c S s" g | ]}d � t|dd� ���qS )�.� N)�join�list)�.0�vr. r. r/ �
s z8Locator.convert_url_to_download_info..)ra �versionrw r, �python-versionzinvalid path for wheel: %szNot downloadable: %sz No match for project/version: %s)ra r� rw r, r� � %s_digest)r �lower�
startswithrp rq � HASHER_HASH�match�groupsrj r$ r% rl ra r� rw r r~ �pyver� Exception�warningrk rg rh �lenr )r9 r, rx ry rQ r5 rm ri �params�query�frag�m�algo�digestZorigpath�wheelZincluderR rw Zextrn ra r� r� r. r. r/ � convert_url_to_download_info� s� �
���
��
z$Locator.convert_url_to_download_infoc C s2 d}dD ]$}d| }||kr||| f} q.q|S )z�
Get a digest from a dictionary by looking at keys of the form
'algo_digest'.
Returns a 2-tuple (algo, digest) if found, else None. Currently
looks only for SHA256, then MD5.
N)Zsha256�md5r� r. )r9 �inforQ r� r? r. r. r/ � _get_digest1 s zLocator._get_digestc C s� |� d�}|� d�}||kr,|| }|j}nt||| jd�}|j}| �|� |_}|d }||d |< |j|d kr�| �|j|�|_|d �|t � ��
|� | |_ |||< dS )z�
Update a result dictionary (the final result from _get_project) with a
dictionary for a specific version, which typically holds information
gleaned from a filename or URL for an archive for the distribution.
ra r� �r5 r, �digests�urlsN) �pop�metadatar r5 r� r� �
source_urlrv �
setdefault�set�add�locator) r9 rQ r� ra r� �dist�mdr� r, r. r. r/ �_update_version_dataA s
z Locator._update_version_dataFc C s� d}t |�}|dkr td| ��t| j�}|�|j� | _}t�d|t|�j � | �
|j �}t |�dk�r2g }|j
} |D ]z}
|
dkr�qxzH|�|
�s�t�d||
� n*|s�| |
�js�|�|
� nt�d|
|j � W qx tk
r� t�d||
� Y qxX qxt |�d k�rt||jd
�}|�r2t�d |� |d } || }|�r�|j�rH|j|_|�d
i ��| t� �|_i } |�di �}
|jD ] }||
k�rv|
| | |< �qv| |_d| _|S )a
Find the most recent distribution which matches the given
requirement.
:param requirement: A requirement of the form 'foo (1.0)' or perhaps
'foo (>= 1.0, < 2.0, != 1.3)'
:param prereleases: If ``True``, allow pre-release versions
to be located. Otherwise, pre-release versions
are not returned.
:return: A :class:`Distribution` instance, or ``None`` if no such
distribution could be located.
NzNot a valid requirement: %rzmatcher: %s (%s)r} �r� r� z%s did not match %rz%skipping pre-release version %s of %szerror matching %s with %rr )r? zsorted list: %srz r� r� )r r r" r5 rI � requirementrp rq �typer@ re ra r� Z
version_classr� Z
is_prereleaserO r� r� �sortedr? ZextrasrN r� �
download_urlsr� )r9 r� � prereleasesrQ �rr5 rI �versionsZslistZvcls�kr� �dZsdr, r. r. r/ �locateX sX
�
zLocator.locate)rF )F)r@ rA rB rC �source_extensions�binary_extensions�excluded_extensionsrl rk rL rS rU rX r[ r] �propertyr5 rb rd re ro rv r r� r� r� r� r. r. r. r/ rD V s.
JrD c s0 e Zd ZdZ� fdd�Zdd� Zdd� Z� ZS )�PyPIRPCLocatorz�
This locator uses XML-RPC to locate distributions. It therefore
cannot be used with simple mirrors (that only mirror file content).
c s* t t| �jf |� || _t|dd�| _dS )z�
Initialise an instance.
:param url: The URL to use for XML-RPC.
:param kwargs: Passed to the superclass constructor.
r& r' N)�superr� rL �base_urlr r- �r9 r, �kwargs�� __class__r. r/ rL � s zPyPIRPCLocator.__init__c C s t | j�� �S �rc )r� r- r+ rT r. r. r/ rd � s z%PyPIRPCLocator.get_distribution_namesc C s i i d�}| j �|d�}|D ]�}| j �||�}| j �||�}t| jd�}|d |_|d |_|�d�|_ |�dg �|_
|�d�|_ t |�}|r |d } | d
|_
| �| �|_| |_|||< |D ]:} | d
}
| �| �} |d �|t� ��|
� | |d |
< q�q |S )
Nr� Tr� ra r� �license�keywords�summaryr r, r� r� )r- Zpackage_releasesZ release_urlsZ release_datar r5 ra r� rN r� r� r� r r� r� r� r� r� r� r� ) r9 ra rQ r� r� r� �datar� r� r� r, r� r. r. r/ rb � s0
zPyPIRPCLocator._get_project�r@ rA rB rC rL rd rb �
__classcell__r. r. r� r/ r� � s r� c s0 e Zd ZdZ� fdd�Zdd� Zdd� Z� ZS )�PyPIJSONLocatorzw
This locator uses PyPI's JSON interface. It's very limited in functionality
and probably not worth using.
c s t t| �jf |� t|�| _d S rV )r� r� rL r r� r� r� r. r/ rL � s zPyPIJSONLocator.__init__c C s t d��dS �rc z Not available from this locatorNr_ rT r. r. r/ rd � s z&PyPIJSONLocator.get_distribution_namesc
C s
i i d�}t | jdt|� �}�z�| j�|�}|�� �� }t�|�}t | j
d�}|d }|d |_ |d |_ |�
d�|_|�
dg �|_|�
d �|_t|�}| |_|d
} |||j < |d
D ]T}
|
d }|j�|� | �|
�|j|< |d
�|j t� ��|� | �|
�|d |< q�|d
�� D ]�\} } | |j k�r4�q t | j
d�}
|j |
_ | |
_ t|
�}| |_||| < | D ]T}
|
d }|j�|� | �|
�|j|< |d
�| t� ��|� | �|
�|d |< �qh�q W n@ tk
�r } z | j� t |�� t � d|� W 5 d }~X Y nX |S )Nr� z%s/jsonr� r� ra r� r� r� r� r� r, r� ZreleaseszJSON fetch failed: %s) r r� r rH �open�read�decode�json�loadsr r5 ra r� rN r� r� r� r r� r� r� r� r� r� r� �itemsr� rK �putr rp � exception)r9 ra rQ r, �respr� r� r� r� r� r� r� ZinfosZomd�odistrR r. r. r/ rb � sT
z PyPIJSONLocator._get_projectr� r. r. r� r/ r� � s r� c @ s` e Zd ZdZe�dejejB ejB �Z e�dejejB �Z
dd� Z e�dej�Z e
dd� �Zd S )
�Pagez4
This class represents a scraped HTML page.
z�
(rel\s*=\s*(?:"(?P[^"]*)"|'(?P[^']*)'|(?P[^>\s
]*))\s+)?
href\s*=\s*(?:"(?P[^"]*)"|'(?P[^']*)'|(?P[^>\s
]*))
(\s+rel\s*=\s*(?:"(?P[^"]*)"|'(?P[^']*)'|(?P[^>\s
]*)))?
z!]+)c C s4 || _ | | _| _| j�| j �}|r0|�d�| _dS )zk
Initialise an instance with the Unicode page contents and the URL they
came from.
r N)r� r� r, �_base�search�group)r9 r� r, r� r. r. r/ rL s
z
Page.__init__z[^a-z0-9$&+,/:;=?@.#%_\\|-]c C s� dd� }t � }| j�| j�D ]�}|�d�}|d pX|d pX|d pX|d pX|d pX|d }|d
pp|d pp|d }t| j|�}t|�}| j� d
d� |�}|�
||f� q t |dd� dd�}|S )z�
Return the URLs of all the links on a page together with information
about their "rel" attribute, for determining which ones to treat as
downloads and which ones to queue for further scraping.
c S s, t | �\}}}}}}t||t|�|||f�S )zTidy up an URL.)r r r )r, r5 rm ri r� r� r� r. r. r/ �clean- s �zPage.links..cleanr3 Zrel1Zrel2Zrel3Zrel4Zrel5Zrel6rr rs Zurl3c S s dt | �d�� S )Nz%%%2xr )�ordr� )r� r. r. r/ �; � z Page.links..c S s | d S )Nr r. )rn r. r. r/ r� ? r� T)r? �reverse) r� �_href�finditerr� � groupdictr r� r � _clean_re�subr� r� )r9 r� rQ r� r� �relr, r. r. r/ �links& s$
��� z
Page.linksN)r@ rA rB rC �re�compile�I�S�Xr� r� rL r� r r� r. r. r. r/ r� s � r� c s� e Zd ZdZejdd� dd� d�Zd � fdd � Zd
d � Zd d
� Z dd� Z
e � de j
�Zdd� Zdd� Zdd� Zdd� Zdd� Ze � d�Zd d � Z� ZS ) �SimpleScrapingLocatorz�
A locator which scrapes HTML pages to locate downloads for a distribution.
This runs multiple threads to do the I/O; performance is at least as good
as pip's PackageFinder, which works in an analogous fashion.
c C s t jtt�d��� S )N)Zfileobj)�gzipZGzipFiler r� r� ��br. r. r/ r� M r� z SimpleScrapingLocator.c C s | S rV r. r� r. r. r/ r� N r� )Zdeflater� ZnoneN�
c sl t t| �jf |� t|�| _|| _i | _t� | _t �
� | _ t� | _ d| _
|| _t�� | _t�� | _d| _dS )a�
Initialise an instance.
:param url: The root URL to use for scraping.
:param timeout: The timeout, in seconds, to be applied to requests.
This defaults to ``None`` (no timeout specified).
:param num_workers: The number of worker threads you want to do I/O,
This defaults to 10.
:param kwargs: Passed to the superclass.
FN)r� r� rL r r� r( � _page_cacher� �_seenr
rJ � _to_fetch�
_bad_hosts�skip_externals� num_workers� threading�RLock�_lock�_gplock�platform_check)r9 r, r( r� r� r� r. r/ rL Q s
z SimpleScrapingLocator.__init__c C sF g | _ t| j�D ]0}tj| jd�}|�d� |�� | j �|� qdS )z�
Threads are created only when get_project is called, and terminate
before it returns. They are there primarily to parallelise I/O (i.e.
fetching web pages).
)�targetTN) �_threads�ranger� r� ZThread�_fetchZ setDaemon�startrO )r9 �irn r. r. r/ �_prepare_threadsl s
z&SimpleScrapingLocator._prepare_threadsc C s6 | j D ]}| j�d� q| j D ] }|�� q g | _ dS )zu
Tell all the threads to terminate (by sending a sentinel value) and
wait for them to do so.
N)r� r� r� r~ )r9 rn r. r. r/ �
_wait_threadsy s
z#SimpleScrapingLocator._wait_threadsc C s� i i d�}| j �x || _|| _t| jdt|� �}| j�� | j�� | � � z&t � d|� | j
�|� | j
�� W 5 | �
� X | `W 5 Q R X |S )Nr� z%s/z Queueing %s)r� rQ rx r r� r r� rW r� r� r� rp rq r� r� r~ )r9 ra rQ r, r. r. r/ rb � s
z"SimpleScrapingLocator._get_projectz<\b(linux_(i\d86|x86_64|arm\w+)|win(32|_amd64)|macosx_?\d+)\bc C s | j �|�S )zD
Does an URL refer to a platform-specific download?
)�platform_dependentr� )r9 r, r. r. r/ �_is_platform_dependent� s z,SimpleScrapingLocator._is_platform_dependentc C sZ | j r| �|�rd}n| �|| j�}t�d||� |rV| j� | �| j|� W 5 Q R X |S )a%
See if an URL is a suitable download for a project.
If it is, register information in the result dictionary (for
_get_project) about the specific version it's for.
Note that the return value isn't actually used other than as a boolean
value.
Nzprocess_download: %s -> %s) r� r� r� rx rp rq r� r� rQ )r9 r, r� r. r. r/ �_process_download� s
z'SimpleScrapingLocator._process_downloadc
C s� t |�\}}}}}}|�| j| j | j �r2d}n|| jrJ|�| j�sJd}nd|�| j�s\d}nR|dkrjd}nD|dkrxd}n6| �|�r�d}n&|� dd�d } | �
� dkr�d}nd}t � d ||||� |S )
z�
Determine whether a link URL from a referring page and with a
particular "rel" attribute should be queued for scraping.
F)ZhomepageZdownload)Zhttprf Zftp�:r r Z localhostTz#should_queue: %s (%s) from %s -> %s)
r rj r� r� r� r� r� r� r� �splitr� rp rq )
r9 �linkZreferrerr� r5 rm ri �_rQ �hostr. r. r/ �
_should_queue� s0 �
�z#SimpleScrapingLocator._should_queuec
C s� | j �� }z�z�|r�| �|�}|dkr,W W ��q |jD ]j\}}|| jkr2zB| j�|� | �|�s�| �|||�r�t �
d||� | j � |� W q2 t k
r� Y q2X q2W n2 t
k
r� } z| j� t|�� W 5 d}~X Y nX W 5 | j �� X |s q�q dS )z�
Get a URL to fetch from the work queue, get the HTML page, examine its
links for download candidates and candidates for further scraping.
This is a handy method to run in a thread.
NzQueueing %s from %s)r� rN rP �get_pager� r� r� r� r rp rq r� r r� rK r )r9 r, �pager r� rR r. r. r/ r� � s,
� & z SimpleScrapingLocator._fetchc C sX t |�\}}}}}}|dkr:tj�t|��r:tt|�d�}|| jkr`| j| }t� d||� �n�|�
dd�d }d}|| j kr�t� d||� �n�t |d d
id �}�z�z�t� d |� | j
j|| jd
�} t� d|� | �� }
|
�dd�} t�| ��r�| �� } | �� }
|
�d�}|�r"| j| }||
�}
d}t�| �}|�r@|�d�}z|
�|�}
W n tk
�rn |
�d�}
Y nX t |
| �}|| j| < W n� t k
�r� } z |j dk�r�t� d||� W 5 d}~X Y n� t k
�r } z0t� d||� | j!� | j �"|� W 5 Q R X W 5 d}~X Y n2 t#k
�rB } zt� d||� W 5 d}~X Y nX W 5 || j|< X |S )a
Get the HTML for an URL, possibly from an in-memory cache.
XXX TODO Note: this cache is never actually cleared. It's assumed that
the data won't get stale over the lifetime of a locator instance (not
necessarily true for the default_locator).
�filez
index.htmlzReturning %s from cache: %sr r r Nz Skipping %s due to bad host %szAccept-encodingZidentity)r> z Fetching %sr' z
Fetched %sz Content-Typer3 zContent-Encodingzutf-8zlatin-1i� zFetch failed: %s: %s)$r �osri �isdirr r r r� rp rq r r� r rH r� r( r� rN �HTML_CONTENT_TYPEr� Zgeturlr� �decoders�CHARSETr� r� r� � UnicodeErrorr� r r< r� r r� r� r� )r9 r, r5 rm ri r rQ r r: r� r> Z content_typeZ final_urlr� �encoding�decoderr� rR r. r. r/ r � sZ
&$ z SimpleScrapingLocator.get_pagez]*>([^<]+)[\w-]+)\s*\(\s*(==\s*)?(?P[^)]+)\)$c @ sL e Zd ZdZddd�Zdd� Zdd� Zd d
� Zd d � Zd
d� Z ddd�Z
dS )�DependencyFinderz0
Locate dependencies for distributions.
Nc C s |pt | _t| jj�| _dS )zf
Initialise an instance, using the specified locator
to locate distributions.
N)�default_locatorr� r" r5 r' r. r. r/ rL * s
zDependencyFinder.__init__c C sr t �d|� |j}|| j|< || j||jf< |jD ]:}t|�\}}t �d|||� | j� |t
� �� ||f� q2dS )z�
Add a distribution to the finder. This will update internal information
about who provides what.
:param dist: The distribution to add.
zadding distribution %szAdd to provided: %s, %s, %sN) rp rq r? �
dists_by_name�distsr� �providesr �providedr� r� r� )r9 r� ra �pr� r. r. r/ �add_distribution2 s
z!DependencyFinder.add_distributionc C sx t �d|� |j}| j|= | j||jf= |jD ]D}t|�\}}t �d|||� | j| }|� ||f� |s.| j|= q.dS )z�
Remove a distribution from the finder. This will update internal
information about who provides what.
:param dist: The distribution to remove.
zremoving distribution %sz Remove from provided: %s, %s, %sN)
rp rq r? r. r/ r� r0 r r1 �remove)r9 r� ra r2 r� �sr. r. r/ �remove_distributionA s
z$DependencyFinder.remove_distributionc C sB z| j �|�}W n, tk
r< |�� d }| j �|�}Y nX |S )z�
Get a version matcher for a requirement.
:param reqt: The requirement
:type reqt: str
:return: A version matcher (an instance of
:class:`distlib.version.Matcher`).
r )r5 rI r# r )r9 �reqtrI ra r. r. r/ � get_matcherS s z DependencyFinder.get_matcherc C st | � |�}|j}t� }| j}||krp|| D ]B\}}z|�|�}W n tk
rZ d}Y nX |r,|�|� qpq,|S )z�
Find the distributions which can fulfill a requirement.
:param reqt: The requirement.
:type reqt: str
:return: A set of distribution which can fulfill the requirement.
F)r8 r? r� r1 r� r# r� ) r9 r7 rI ra rQ r1 r� �providerr� r. r. r/ �find_providersc s
z DependencyFinder.find_providersc C s� | j | }t� }|D ]$}| �|�}|�|j�s|�|� q|rZ|�d||t|�f� d}n@| �|� | j |= |D ]}| j �|t� ��|� qp| � |� d}|S )a�
Attempt to replace one provider with another. This is typically used
when resolving dependencies from multiple sources, e.g. A requires
(B >= 1.0) while C requires (B >= 1.1).
For successful replacement, ``provider`` must meet all the requirements
which ``other`` fulfills.
:param provider: The provider we are trying to replace with.
:param other: The provider we're trying to replace.
:param problems: If False is returned, this will contain what
problems prevented replacement. This is currently
a tuple of the literal string 'cantreplace',
``provider``, ``other`` and the set of requirements
that ``provider`` couldn't fulfill.
:return: True if we can replace ``other`` with ``provider``, else
False.
Z cantreplaceFT)
�reqtsr� r8 r� r� r� � frozensetr6 r� r3 ) r9 r9 �other�problemsZrlistZ unmatchedr5 rI rQ r. r. r/ �try_to_replace{ s$
�
z DependencyFinder.try_to_replaceFc C s� i | _ i | _i | _i | _t|p g �}d|krH|�d� |tdddg�O }t|t�rh| }}t� d|� n4| j
j ||d� }}|dkr�t d| ��t� d |� d
|_
t� }t|g�}t|g�}|�r�|�� }|j} | | jkr�| �|� n"| j| }
|
|k�r| �||
|� |j|jB } |j} t� }
|�r`||k�r`d D ]*}d | }||k�r4|
t|d
| �O }
�q4| | B |
B }|D �].}| �|�}|�sFt� d|� | j
j ||d�}|dk�r�|�s�| j
j |d
d�}|dk�r�t� d|� |�d|f� n^|j|j }}||f| jk�r|�|� |�|� || k�rF||k�rF|�|� t� d|j� |D ]R}|j} | | jk�rx| j�|t� ��|� n"| j| }
|
|k�rJ| �||
|� �qJ�qpq�t| j�� �}|D ]&}||k|_ |j �r�t� d|j� �q�t� d|� ||fS )a�
Find a distribution and all distributions it depends on.
:param requirement: The requirement specifying the distribution to
find, or a Distribution instance.
:param meta_extras: A list of meta extras such as :test:, :build: and
so on.
:param prereleases: If ``True``, allow pre-release versions to be
returned - otherwise, don't return prereleases
unless they're all that's available.
Return a set of :class:`Distribution` instances and a set of
problems.
The distributions returned should be such that they have the
:attr:`required` attribute set to ``True`` if they were
from the ``requirement`` passed to ``find()``, and they have the
:attr:`build_time_dependency` attribute set to ``True`` unless they
are post-installation dependencies of the ``requirement``.
The problems should be a tuple consisting of the string
``'unsatisfied'`` and the requirement which couldn't be satisfied
by any distribution known to the locator.
z:*:z:test:z:build:z:dev:zpassed %s as requirement)r� NzUnable to locate %rz
located %sT)ZtestZbuildZdevz:%s:z %s_requireszNo providers found for %rzCannot satisfy %rZ unsatisfiedzAdding %s to install_distsz#%s is a build-time dependency only.zfind done for %s) r1 r/ r. r; r� r4 �
isinstancer rp rq r� r� r Z requestedr� r? r3 r? Z run_requiresZ
meta_requiresZbuild_requires�getattrr: r� r� Zname_and_versionr� �valuesZbuild_time_dependency)r9 r� Z meta_extrasr� r� r� r> ZtodoZ
install_distsra r= ZireqtsZsreqtsZereqtsr? rR Z all_reqtsr� Z providersr9 �nr� r2 r/ r. r. r/ �find� s�
�
�
� zDependencyFinder.find)N)NF) r@ rA rB rC rL r3 r6 r8 r: r? rD r. r. r. r/ r, % s
(r, )N)Or� �ior r� Zloggingr rg r� r� � ImportErrorZdummy_threadingr r3 r �compatr r r r r r
r r r
r r r7 r r r r Zdatabaser r r r� r r �utilr r r r r r r r r! r� r" r# r� r$ r% Z getLoggerr@ rp r� r� r� r
r r* r0 r1 �objectrD r� r� r� r� r r r" r$ r- r� ZNAME_VERSION_REr, r. r. r. r/ � s^ D,
@0E: zA& [��