U
��.eEQ � @ s� d dl mZ d dlZd dlZd dlZd dlZd dlZd dlZd dlZd dl m
Z
d dl m Z m
Z
d dlmZ d dlmZ d dlmZmZ d dlmZ d d lmZ d d
lmZ d d l m Z d d l m Z m Z m!Z!m"Z"m#Z#m$Z$m%Z%m&Z&m'Z' d d
l(m)Z) d dl*m+Z+ d dl,m-Z- d dl.m/Z/ d dl0m1Z1 d dl2m3Z3 e+�r�d dl4m5Z5m6Z6m7Z7m8Z8m9Z9m:Z: d dl;mZ> d dl?m@Z@ d dlAmBZB e�r�ed0d �ZSd1d2� ZTd3d4� ZUd?d5d �ZVd@d6d!�ZWd7d#� ZXd8d"� ZYd9d:� ZZd;d<� Z[dS )A� )�absolute_importN)�requests)�CONTENT_CHUNK_SIZE�Response)�PY2)�parse)� HashMismatch�InstallationError)�PyPI)�
PipSession)� auto_decode)� copy2_fixed) �ask_path_exists�
backup_dir�consume� display_path� format_size�hide_url�path_to_display�rmtree�splitext)�
TempDirectory)�MYPY_CHECK_RUNNING)�DownloadProgressProvider)� unpack_file)�get_url_scheme)�vcs)�IO�Callable�List�Optional�Text�Tuple)� TypedDict)�Link)�Hashes)�VersionControl�CopytreeKwargs��ignore�symlinksF)Ztotal)�
copy_functionr) Zignore_dangling_symlinksr* �get_file_content�unpack_vcs_link�unpack_file_url�unpack_http_url�
unpack_url�parse_content_disposition�sanitize_content_filenamec
C s6 |dkrt d��t| �}|dkr>|�| �}|�� |j|jfS |dkr�|rd|�d�rdtd|| f ��| �dd�d }|� d d
�}t
� |�}|r�|� d�d |�d d�d }t
�|�}|�d
�r�d
|�d
� }|} z&t| d ��}t|�� �}W 5 Q R X W n4 tk
�r, } ztd
t| � ��W 5 d} ~ X Y nX | |fS )a* Gets the content of a file; it may be a filename, file: URL, or
http: URL. Returns (location, content). Content is unicode.
:param url: File path or url.
:param comes_from: Origin description of requirements.
:param session: Instance of pip.download.PipSession.
NzAget_file_content() missing 1 required keyword argument: 'session')�httpZhttps�filer3 z6Requirements file %s references URL %s, which is local�:� �\�/�|�rbz$Could not open requirements file: %s)� TypeErrorr �get�raise_for_status�url�text�
startswithr �split�replace�_url_slash_drive_re�match�group� urllib_parseZunquote�lstrip�openr �read�IOError�str)
r> Z
comes_from�session�scheme�resp�pathrD �fZcontent�exc� rR �:/usr/lib/python3.8/site-packages/pip/_internal/download.pyr, U sB �
��
�z /*([a-z])\|c C s, t | �}|d k st�|j|t| j�d� d S )N)r> )�_get_used_vcs_backend�AssertionError�unpackr r> )�link�location� vcs_backendrR rR rS r- � s c C s$ t jD ]}| j|jkr| S qdS )z1
Return a VersionControl object or None.
N)r ZbackendsrM Zschemes)rW rY rR rR rS rT � s
rT c O s | S �NrR )�iterable�args�kwargsrR rR rS �_progress_indicator� s r^ c
s6 zt �jd �}W n tttfk
r0 d}Y nX t�dd�}t�� tj krRd}n&|r\d}n |dkrjd}n|std}nd}|j
}�fdd�} � fd d
�}
t } |j t
j kr�|} n|j} |r�t||d �} |r�t�d | t|�� n t�d
| � n |r�t�d| � n t�d
| � |
| | t�t��}
|�r*|�|
� nt|
� d S )Nzcontent-lengthr Z
from_cacheFi@� Tc 3 sT z � j j| dd�D ]
}|V qW n. tk
rN � j �| �}|sBqJ|V q0Y nX d S )NF)Zdecode_content)�raw�stream�AttributeErrorrI )Z
chunk_size�chunk)rN rR rS � resp_read� s �
z _download_url..resp_readc 3 s | D ]}� � |� |V qd S rZ )�write)Zchunksrb )� content_filerR rS �written_chunks� s
z%_download_url..written_chunks)�maxzDownloading %s (%s)zDownloading %szUsing cached %s)�int�headers�
ValueError�KeyErrorr; �getattr�loggerZgetEffectiveLevel�logging�INFO�show_urlr^ Znetlocr
Zurl_without_fragmentr �infor r Zcheck_against_chunksr )rN rW re �hashes� progress_barZ total_lengthZ cached_respZ
show_progressrp rc rf Zprogress_indicatorr> Zdownloaded_chunksrR )re rN rS �
_download_url� sP
% � �� rt c C s� d}t j�||j�}t j�|�r�tdt|� d�}|dkr@d}nj|dkrdt�dt|�� t � |� nF|dkr�t
|�}t�d t|�t|�� t � ||� n|d
kr�t
�d � |r�t �| |� t�d t|�� d S )
NTz8The file %s exists. (i)gnore, (w)ipe, (b)ackup, (a)abort)�i�w�b�aru Frv z Deleting %srw zBacking up %s to %srx �����zSaved %s)�osrO �join�filename�existsr r rm �warning�remover �shutilZmove�sys�exit�copyrq )r| rX rW r� Zdownload_location�responseZ dest_filerR rR rS �
_copy_file s6 �� �
r� �onc
C s� |d krt d��tdd��v}d }|r0t| ||�}|rH|}t�|�d } nt| ||j||�\}} t||| � |r~|s~t||| � |s�t �
|� W 5 Q R X d S )Nz@unpack_http_url() missing 1 required keyword argument: 'session'rV )Zkindr ) r; r �_check_download_dir� mimetypes�
guess_type�_download_http_urlrO r r� rz �unlink)
rW rX � download_dirrL rr rs �temp_dir�already_downloaded_path� from_path� content_typerR rR rS r/ s2 � �� c
C sT zt | |� W n@ tjk
rN } z t�dt|�t| �t|�� W 5 d}~X Y nX dS )z�Copying special files is not supported, but as a convenience to users
we skip errors copying them. This supports tools that may create e.g.
socket files in the project source directory.
z>Ignoring special file error '%s' encountered copying %s to %s.N)r
r� ZSpecialFileErrorrm r~ rK r )�src�dest�erR rR rS � _copy2_ignoring_special_filesJ s �r� c s` t j�|�}t j�|��t j�|��� ��fdd�}t|dd�}tsLt|d< tj � |f|� d S )Nc s6 g }| � kr|ddg7 }t j�| ��kr2|�g7 }|S )Nz.toxz.nox)rz rO �abspath)�d�namesZskipped��sourceZtarget_basenameZtarget_dirnamerR rS r) e s
z!_copy_source_tree..ignoreTr( r+ )
rz rO r� �basename�dirname�dictr r� r� Zcopytree)r� �targetZtarget_abspathr) r] rR r� rS �_copy_source_tree_ s r� c C s� | j }| �� r>tj�|�r"t|� t||� |r:t�d� dS |rL|� |� d}|r`t
| ||�}|rj|}n|}t � |�d }t
|||� |r�|s�t||| � dS )z�Unpack link into location.
If download_dir is provided and link points to a file, make a copy
of the link file inside download_dir.
z*Link is a directory, ignoring download_dirNr )� file_pathZis_existing_dirrz rO �isdirr r� rm rq �check_against_pathr� r� r� r r� )rW rX r� rr Z link_pathr� r� r� rR rR rS r. ~ s.
� c C sP | j rt| |� n:| jr*t| |||d� n"|dkr8t� }t| |||||d� dS )av Unpack link.
If link is a VCS link:
if only_download, export into download_dir and ignore location
else unpack into location
for other types of link:
- unpack into location
- if download_dir, copy the file into download_dir
- if only_download, mark location for deletion
:param hashes: A Hashes object, one of whose embedded hashes must match,
or HashMismatch will be raised. If the Hashes is empty, no matches are
required, and unhashable types of requirements (like VCS ones, which
would ordinarily raise HashUnsupported) are allowed.
)rr N)rr rs )Zis_vcsr- �is_filer. r r/ )rW rX r� rL rr rs rR rR rS r0 � s �c C s t j�| �S )zJ
Sanitize the "filename" value from a Content-Disposition header.
)rz rO r� )r| rR rR rS r2 � s c C s, t �| �\}}|�d�}|r$t|�}|p*|S )z�
Parse the "filename" value from a Content-Disposition header, and
return the default filename if the result is empty.
r| )�cgiZ parse_headerr< r2 )�content_dispositionZdefault_filenameZ_typeZparamsr| rR rR rS r1 � s
c
C s* | j �dd�d }z |j|ddidd�}|�� W n8 tjk
rj } zt�d|jj | � � W 5 d }~X Y nX |j
�d
d �}| j } |j
�d �}
|
r�t |
| �} t
| �d } | s�t�|�} | r�| | 7 } | s�| j |j kr�tj�
|j �d } | r�| | 7 } tj�|| �} t| d
��}
t|| |
||� W 5 Q R X | |fS )z6Download link url into temp_dir using provided session�#r6 r zAccept-EncodingZidentityT)ri r` z HTTP error %s while getting %sNz content-type� zcontent-disposition�wb)r> rA r< r= r Z HTTPErrorrm Zcriticalr� Z status_coderi r| r1 r r� Zguess_extensionrz rO r{ rH rt )rW rL r� rr rs Z
target_urlrN rQ r� r| r� Zextr� re rR rR rS r� � sB � �
r� c C sp t j�|| j�}t j�|�s dS t�d|� |rlz|�|� W n, tk
rj t� d|� t �
|� Y dS X |S )z� Check download_dir for previously downloaded file with correct hash
If a correct file is found return its path else None
Nz File was already downloaded %sz;Previously-downloaded file %s has bad hash. Re-downloading.) rz rO r{ r| r} rm rq r� r r~ r� )rW r� rr Z
download_pathrR rR rS r� 7 s �
r� )NN)NNNr� )NN)NNNr� )\Z
__future__r r� rn r� rz �rer� r� Z pip._vendorr Zpip._vendor.requests.modelsr r Zpip._vendor.sixr Z pip._vendor.six.moves.urllibr rF Zpip._internal.exceptionsr r Zpip._internal.models.indexr
Z pip._internal.network.sessionr Z pip._internal.utils.encodingr Z pip._internal.utils.filesystemr
Zpip._internal.utils.miscr r r r r r r r r Z pip._internal.utils.temp_dirr Zpip._internal.utils.typingr Zpip._internal.utils.uir Z pip._internal.utils.unpackingr Zpip._internal.utils.urlsr Zpip._internal.vcsr �typingr r r r r! r" Zmypy_extensionsr# Zpip._internal.models.linkr$ Zpip._internal.utils.hashesr% Z pip._internal.vcs.versioncontrolr& rK �boolr' �__all__Z getLogger�__name__rm r, �compile�IrC r- rT r^ rt r� r/ r� r� r. r0 r2 r1 r� r� rR rR rR rS � s� , �� �� �
0 d �
-" �
8 �
.?