U
��.e�� � @ s� d dl Z d dlmZ d dlZd dlZd dlmZ d dlZd dl Z d dl
Z
d dl Z d dl Z d dl
Z
d dlZz d dlZW n ek
r� dZY nX d dlZd dlZd dlZd dlZd dlZz d dlZW n ek
r� d dlZY nX d dlZddlmZ ddlm Z m Z m Z m Z m Z m!Z!m"Z"m#Z#m$Z$m%Z%m&Z&m'Z'm(Z(m)Z)m*Z*m+Z+m,Z,m-Z-m.Z.m/Z/m0Z0 e
�1e2�Z3e
�4d�Z5e
�4d�Z6e
�4d �Z7e
�4d
�Z8e
�4d �Z9e
�4d �Z:e
�4d
�Z;e
�4d�Zdd� Z?dd� Z@dd� ZAd�dd�ZBdd � ZCd d � ZDd d � ZEejFd!d"� �ZGejFd#d$� �ZHejFd�d&d'��ZIG d(d)� d)eJ�ZKd*d+� ZLG d,d-� d-eJ�ZMd.d/� ZNG d0d1� d1eJ�ZOe
�4d2e
jP�ZQd3d4� ZRd�d5d6�ZSd7d8� ZTd9d:� ZUd;d<� ZVd=d>� ZWd?d@� ZXe
�4dAe
jY�ZZe
�4dB�Z[d�dCdD�Z\e
�4dE�Z]dFdG� Z^dHdI� Z_dJdK� Z`dLZadMdN� ZbdOdP� ZcG dQdR� dReJ�ZdG dSdT� dTeJ�ZeG dUdV� dVeJ�ZfdWZgd�dYdZ�Zhd[d\� Zid]ZjG d^d_� d_eJ�Zke
�4d`�Zle
�4da�Zme
�4db�Zndcdd� Zdedf� Zoe�r�ddglmpZqmrZrmsZs G dhdi� die$jt�ZtG djdk� dkeq�ZpG dldm� dmepe'�Zuejvddn� Zwewdok�rG dpdq� dqe$jx�Zxe�rG drds� dse$jy�ZyG dtdu� due%jz�Zze�rBG dvdw� dwe%j{�Z{G dxdy� dye%j|�Z|dzd{� Z}G d|d}� d}eJ�Z~G d~d� de~�ZG d�d�� d�e~�Z�G d�d�� d�e(�Z�G d�d�� d�eJ�Z�d�d�� Z�dS )�� N)�deque)�iglob� )�DistlibException)� string_types� text_type�shutil� raw_input�StringIO�cache_from_source�urlopen�urljoin�httplib� xmlrpclib� splittype� HTTPHandler�BaseConfigurator� valid_ident� Container� configparser�URLError�ZipFile�fsdecode�unquote�urlparsez^([\w\.-]+)\s*z^([\w\.*+-]+)\s*z^(<=?|>=?|={2,3}|[~!]=)\s*z*^((<=?)|(>=?)|={2,3}|[~!]=|in|not\s+in)\s*z^or\b\s*z ^and\b\s*z(\S+)\s*z(([\s\w\.{}()*+#:;,/?!~`@$%^&=|<>\[\]-]+)c s6 dd� �� �fdd���fdd���fdd�� � | �S ) ae
Parse a marker string and return a dictionary containing a marker expression.
The dictionary will contain keys "op", "lhs" and "rhs" for non-terminals in
the expression grammar, or strings. A string contained in quotes is to be
interpreted as a literal string, and a string not contained in quotes is a
variable (such as os_name).
c S s. t �| �}|r,|�� d }| |�� d � } n�| s:td��n�| d }|dkrVtd| ��d�|d�}| dd � } |g}| r�| d |kr��qqt| d |kr�|�|� | dd � } qtt�| �}|s�td| ��|�|�� d � | |�� d � } qtd�|�}td| ��|�|� d�|�}| dd � � � } || fS ) Nr zunexpected end of inputz'"zinvalid expression: %s� r zerror in string literal: %szunterminated string: %s)
�
IDENTIFIER�match�groups�end� SyntaxError�replace�append� STRING_CHUNK�join�lstrip)� remaining�m�result�qZoq�parts�s� r, �.marker_varc s� | rR| d dkrR� | dd � � � �\}} | d dkr@td| ��| dd � � � } nZ�| �\}} | r�t�| �}|srq�|�� d }| |�� d � } �| �\}} |||d�}q^|}|| fS )Nr �(r �)� unterminated parenthesis: %s��op�lhs�rhs)r% r � MARKER_OPr r r )r& r( r4 r' r3 r5 )�markerr. r, r- � marker_expre s
z!parse_marker..marker_exprc sR � | �\}} | rJt �| �}|s qJ| |�� d � } � | �\}} d||d�}q || fS )N�andr2 )�ANDr r �r& r4 r' r5 )r8 r, r- �
marker_andx s
z parse_marker..marker_andc sR � | �\}} | rJt �| �}|s qJ| |�� d � } � | �\}} d||d�}q || fS )N�orr2 )�ORr r r; )r< r, r- r7 � s
z parse_marker..markerr, )Z
marker_stringr, )r7 r< r8 r. r- � parse_marker8 s
$ r? c C s0 | � � }|r|�d�rdS t�|�}|s4td| ��|�� d }||�� d� }d } } }}|�r:|d dk�r:|�dd�}|dk r�td| ��|d|� } ||d d� �� }g }| �r0t�| �}|s�td | ��|� |�� d � | |�� d� } | �s�q0| d d
k�r td | ��| dd� �� } q�|�s:d}|�r�|d d k�r�|dd� �� }t
�|�}|�sztd
| ��|�� d }t |�}
|
j �r�|
j
�s�td| ��||�� d� �� }n�dd� } |d dk�r�| |�\}}n�|�dd�}|dk �rtd| ��|d|� } ||d d� �� }t�| ��r@| | �\}} nXt�| �}|�s\td| ��|�� d }
| |�� d� �� } | �r�td| ��d|
fg}|�r�|d dk�r�td| ��|dd� �� }t|�\}}|�r�|d dk�r�td| ��|�s |}n d|d�dd � |D ��f }t||||||d �S ) z�
Parse a requirement passed in as a string. Return a Container
whose attributes contain the various parts of the requirement.
�#Nzname expected: %sr �[�]r zunterminated extra: %szmalformed extra: %s�,z comma expected in extras: %s�@zinvalid URI: %szInvalid URL: %sc S s� t �| �}d}|r�g }|�� d }| |�� d� } t�| �}|sLtd| ��|�� d }|�||f� | |�� d� } | r�| d dkr�q�| dd� �� } t �| �}|std| ��q|s�d}|| fS )z|
Return a list of operator, version tuples if any are
specified, else None.
Nr zinvalid version: %srC r �invalid constraint: %s)�
COMPARE_OPr r r �VERSION_IDENTIFIERr r" r% )Z
ver_remainingr' �versionsr3 �vr, r, r- � get_versions� s*
z'parse_requirement..get_versionsr/ r0 r1 rE z~=�;zinvalid requirement: %sz unexpected trailing data: %s�%s %s�, c S s g | ] }d | �qS )rL r, )�.0Zconr, r, r- �
s z%parse_requirement..)�name�extrasZ constraintsr7 �urlZ requirement)�strip�
startswithr r r r r �findr% r" � NON_SPACEr �scheme�netlocrF rG r? r$ r )�reqr& r' ZdistnamerQ Z mark_exprrH �uri�ir+ �trJ �_rI Zrsr, r, r- �parse_requirement� s�
�r^ c C s� dd� }i }|D ]�\}}}t j�| |�}t|�D ]p}t j�||�} t| �D ]T}
|| |
�} |dkrn|�| d� qJ|||
�} |�t jjd��d�}
|
d | || < qJq0q|S )z%Find destinations for resources filesc S sD | � tjjd�} |� tjjd�}|�| �s.t�|t| �d � �d�S �N�/)r! �os�path�seprT �AssertionError�lenr% )�rootrb r, r, r- � get_rel_path
s z)get_resources_dests..get_rel_pathNr` )ra rb r$ r �popr! rc �rstrip)Zresources_rootZrulesrg Z destinations�base�suffix�dest�prefixZabs_baseZabs_globZabs_pathZ
resource_fileZrel_pathZrel_destr, r, r- �get_resources_dests
s
rn c C s( t td�rd} ntjttdtj�k} | S )NZ real_prefixT� base_prefix)�hasattr�sysrm �getattr�r( r, r, r- �in_venv$ s
rt c C s$ t j�tj�} t| t�s t| �} | S �N)ra rb �normcaserq �
executable�
isinstancer r rs r, r, r- �get_executable. s
ry c C sN | }t |�}| }|s |r |}|r|d �� }||kr6qJ|rd||| f }q|S )Nr z %c: %s
%s)r �lower)�promptZ
allowed_charsZ error_prompt�default�pr+ �cr, r, r- �proceed> s r c C s8 t |t�r|�� }i }|D ]}|| kr| | ||< q|S ru )rx r �split)�d�keysr( �keyr, r, r- �extract_by_keyN s
r� c C sz t jd dkr t�d�| �} | �� }t|�} zlt�| �}|d d d }|�� D ]B\}}|�� D ]0\}}d||f }t |�} | d k s�t
�| ||< q`qP|W S t k
r� | � dd� Y nX dd � }
t
�� } z|
| | � W n< t
jk
�r | �� t�|�}t|�} |
| | � Y nX i }| �� D ]R} i || < }| �| �D ]4\}
}d|
|f }t |�} | d k �sft
�| ||
< �q<�q"|S )
Nr � �utf-8�
extensionszpython.exports�exportsz%s = %sc S s$ t | d�r| �|� n
| �|� d S )N� read_file)rp r� Zreadfp)�cp�streamr, r, r- � read_streamk s
z!read_exports..read_stream)rq � version_info�codecs� getreader�readr
�json�load�items�get_export_entryrd � Exception�seekr � ConfigParserZMissingSectionHeaderError�close�textwrap�dedentZsections)r� �dataZjdatar( �group�entries�krI r+ �entryr� r� r� rP �valuer, r, r- � read_exportsW sD
r� c C s� t jd dkr t�d�|�}t�� }| �� D ]l\}}|�|� |�� D ]P}|j d kr\|j
}nd|j
|j f }|j r�d|d� |j �f }|�
||j|� qFq,|�|� d S )Nr r� r� z%s:%sz%s [%s]rM )rq r� r� � getwriterr r� r� Z add_section�valuesrk rm �flagsr$ �setrP �write)r� r� r� r� rI r� r+ r, r, r- �
write_exports� s
r� c c s$ t �� } z
| V W 5 t�| � X d S ru )�tempfile�mkdtempr �rmtree)Ztdr, r, r- �tempdir� s
r� c c s. t �� }zt �| � d V W 5 t �|� X d S ru )ra �getcwd�chdir)r� �cwdr, r, r- r� � s
r� � c c s. t �� }zt �| � d V W 5 t �|� X d S ru )�socketZgetdefaulttimeoutZsetdefaulttimeout)ZsecondsZctor, r, r- �socket_timeout� s
r� c @ s e Zd Zdd� Zddd�ZdS )�cached_propertyc C s
|| _ d S ru )�func)�selfr� r, r, r- �__init__� s zcached_property.__init__Nc C s, |d kr | S | � |�}t�|| j j|� |S ru )r� �object� __setattr__�__name__)r� �obj�clsr� r, r, r- �__get__� s
zcached_property.__get__)N)r� �
__module__� __qualname__r� r� r, r, r, r- r� � s r� c C s~ t jdkr| S | s| S | d dkr.td| ��| d dkrFtd| ��| �d�}t j|krh|�t j� qP|srt jS t jj|� S )a� Return 'pathname' as a name that will work on the native filesystem.
The path is split on '/' and put back together again using the current
directory separator. Needed because filenames in the setup script are
always supplied in Unix style, and have to be converted to the local
convention before we can actually use them in the filesystem. Raises
ValueError on non-Unix-ish systems if 'pathname' either starts or
ends with a slash.
r` r z path '%s' cannot be absolute�����z path '%s' cannot end with '/')ra rc �
ValueErrorr� �curdir�removerb r$ )�pathname�pathsr, r, r- � convert_path� s
r� c @ s� e Zd Zd$dd�Zdd� Zdd� Zdd � Zd%d d �Zd&dd�Zdd� Z dd� Z
dd� Z dd� Z dd� Z
d'dd�Zd d � Zd d � Zd d!� Zd"d#� Zd
S )(� FileOperatorFc C s || _ t� | _| �� d S ru )�dry_runr� �ensured� _init_record)r� r� r, r, r- r� � s zFileOperator.__init__c C s d| _ t� | _t� | _d S �NF)�recordr� �
files_written� dirs_created�r� r, r, r- r� � s zFileOperator._init_recordc C s | j r| j�|� d S ru )r� r� �add)r� rb r, r, r- �record_as_written� s z FileOperator.record_as_writtenc C sH t j�|�s tdt j�|� ��t j�|�s0dS t �|�jt �|�jkS )a� Tell if the target is newer than the source.
Returns true if 'source' exists and is more recently modified than
'target', or if 'source' exists and 'target' doesn't.
Returns false if both exist and 'target' is the same age or younger
than 'source'. Raise PackagingFileError if 'source' does not exist.
Note that this test is not very accurate: files created in the same
second will have the same "age".
zfile '%r' does not existT)ra rb �existsr �abspath�stat�st_mtime)r� �source�targetr, r, r- �newer� s
� zFileOperator.newerTc C s� | � tj�|�� t�d||� | js�d}|rdtj�|�rDd| }n tj�|�rdtj� |�sdd| }|rtt
|d ��t � ||� | �
|� dS )z8Copy a file respecting dry-run and force flags.
zCopying %s to %sNz%s is a symlinkz%s is a non-regular filez which would be overwritten)�
ensure_dirra rb �dirname�logger�infor� �islinkr� �isfiler� r Zcopyfiler� )r� Zinfile�outfile�check�msgr, r, r- � copy_file s
zFileOperator.copy_fileNc C s� t j�|�rt�| �t j�|�� t�d||� | jsv|d krJt |d�}nt
j |d|d�}zt �
||� W 5 |� � X | �|� d S )NzCopying stream %s to %s�wb�w��encoding)ra rb �isdirrd r� r� r� r� r� �openr� r� r Z copyfileobjr� )r� Zinstreamr� r� Z outstreamr, r, r- � copy_stream s
zFileOperator.copy_streamc C s\ | � tj�|�� | jsNtj�|�r.t�|� t|d��}|�|� W 5 Q R X | � |� d S )Nr� )
r� ra rb r� r� r� r� r� r� r� )r� rb r� �fr, r, r- �write_binary_file! s
z FileOperator.write_binary_filec C s | � ||�|�� d S ru )r� �encode)r� rb r� r� r, r, r- �write_text_file* s z FileOperator.write_text_filec C sn t jdks t jdkrjt jdkrj|D ]F}| jr:t�d|� q"t �|�j|B |@ }t�d||� t �||� q"d S )N�posix�javazchanging mode of %szchanging mode of %s to %o) ra rP �_namer� r� r� r� �st_mode�chmod)r� �bits�mask�filesr� �moder, r, r- �set_mode- s zFileOperator.set_modec C s | � dd|�S )Nim i� )r� )r+ r� r, r, r- �9 � zFileOperator.c C s| t j�|�}|| jkrxt j�|�sx| j�|� t j�|�\}}| �|� t� d| � | j
sft � |� | j rx| j
�|� d S )Nz Creating %s)ra rb r� r� r� r� r� r� r� r� r� �mkdirr� r� )r� rb r� r� r, r, r- r� ; s
zFileOperator.ensure_dirc C s� t || �}t�d||� | js�|s0| �||�rX|s:d }n |�|�sHt�|t|�d � }i }|rvtt d�rvt j
j |d< t j |||df|� | �
|� |S )NzByte-compiling %s to %s�PycInvalidationMode�invalidation_modeT)r r� r� r� r� rT rd re rp �
py_compiler� � CHECKED_HASH�compiler� ) r� rb �optimize�forcerm Zhashed_invalidationZdpathZdiagpathZcompile_kwargsr, r, r- � byte_compileG s
zFileOperator.byte_compilec C s� t j�|�r�t j�|�r^t j�|�s^t�d|� | js@t� |� | j
r�|| j kr�| j � |� nPt j�|�rpd}nd}t�d||� | js�t � |� | j
r�|| j
kr�| j
� |� d S )Nz Removing directory tree at %s�link�filezRemoving %s %s)ra rb r� r� r� r� �debugr� r r� r� r� r� r� )r� rb r+ r, r, r- �ensure_removedX s"
zFileOperator.ensure_removedc C sD d}|s@t j�|�r$t �|t j�}q@t j�|�}||kr:q@|}q|S r� )ra rb r� �access�W_OKr� )r� rb r( �parentr, r, r- � is_writablem s zFileOperator.is_writablec C s" | j s
t�| j| jf}| �� |S )zV
Commit recorded changes, turn off recording, return
changes.
)r� rd r� r� r� )r� r( r, r, r- �commity s
zFileOperator.commitc C s� | j s�t| j�D ]}tj�|�rt�|� qt| jdd�}|D ]F}t� |�}|rz|dgks^t
�tj� ||d �}t� |� t� |� q>| �
� d S )NT)�reverse� __pycache__r )r� �listr� ra rb r� r� �sortedr� �listdirrd r$ �rmdirr� )r� r� �dirsr� �flistZsdr, r, r- �rollback� s
zFileOperator.rollback)F)T)N)FFNF)r� r� r� r� r� r� r� r� r� r� r� r� Zset_executable_moder� r r r r r r, r, r, r- r� � s
r� c C s^ | t jkrt j| }nt| �}|d kr,|}n.|�d�}t||�d��}|D ]}t||�}qJ|S )N�.r )rq �modules�
__import__r� rr rh )Z module_nameZ dotted_path�modr( r* r} r, r, r- �resolve� s
r c @ s6 e Zd Zdd� Zedd� �Zdd� Zdd� Zej Z d S )
� ExportEntryc C s || _ || _|| _|| _d S ru �rP rm rk r� )r� rP rm rk r� r, r, r- r� � s zExportEntry.__init__c C s t | j| j�S ru )r rm rk r� r, r, r- r� � s zExportEntry.valuec C s d| j | j| j| jf S )Nzr r� r, r, r- �__repr__� s
�zExportEntry.__repr__c C sD t |t�sd}n0| j|jko>| j|jko>| j|jko>| j|jk}|S r� )rx r rP rm rk r� )r� �otherr( r, r, r- �__eq__� s
�
�
�zExportEntry.__eq__N)
r� r� r� r� r� r� r r r� �__hash__r, r, r, r- r � s
r z�(?P(\w|[-.+])+)
\s*=\s*(?P(\w+)([:\.]\w+)*)
\s*(\[\s*(?P\w+(=\w+)?(,\s*\w+(=\w+)?)*)\s*\])?
c
C s� t �| �}|s0d }d| ks"d| kr�td| ��n�|�� }|d }|d }|�d�}|dkrf|d }}n"|dkrztd| ��|�d�\}}|d } | d kr�d| ks�d| kr�td| ��g } nd
d � | �d �D �} t|||| �}|S )
NrA rB zInvalid specification '%s'rP �callable�:r r r� c S s g | ] }|� � �qS r, )rS )rN r� r, r, r- rO � s z$get_export_entry..rC )�ENTRY_RE�searchr � groupdict�countr� r )
Z
specificationr' r( r� rP rb Zcolonsrm rk r� r, r, r- r� � s8
�
��r� c C s� | dkr d} t jdkr.dt jkr.t j�d�}n t j�d�}t j�|�rft �|t j�}|s�t �
d|� n| � dd�\}} d|kr.|}n|�dd�\}}|rJt|�}|rVt|�}||| fS )NrD r r )�rsplitr� r )rX ZusernameZpasswordrm r, r, r- �parse_credentials$ s r3 c C s t �d�} t �| � | S )N� )ra �umaskrs r, r, r- �get_process_umask3 s
r6 c C s< d}d }t | �D ]\}}t|t�sd} q,q|d k s8t�|S )NTF)� enumeraterx r rd )�seqr( r[ r+ r, r, r- �is_string_sequence8 s
r9 z3([a-z0-9_]+([.-][a-z_][a-z0-9_]*)*)-([a-z0-9_.+-]+)z
-py(\d\.?\d?)c C s� d}d}t | ��dd�} t�| �}|r@|�d�}| d|�� � } |r�t| �t|�d kr�t�t� |�d | �}|r�|�
� }| d|� | |d d� |f}|dkr�t �| �}|r�|�d�|�d�|f}|S )zw
Extract name, version, python version from a filename (no extension)
Return name, version, pyver or None
N� �-r z\br� ) r r! �PYTHON_VERSIONr! r� �startre �rer �escaper �PROJECT_NAME_AND_VERSION)�filenameZ project_namer( Zpyverr' �nr, r, r- �split_filenameG s"
rC z-(?P[\w .-]+)\s*\(\s*(?P[^\s)]+)\)$c C s: t �| �}|std| ��|�� }|d �� �� |d fS )z�
A utility method used to get name and version from a string.
From e.g. a Provides-Dist value.
:param p: A value in a form 'foo (1.0)'
:return: The name and version as a tuple.
z$Ill-formed name/version string: '%s'rP Zver)�NAME_VERSION_REr r r" rS rz )r} r' r� r, r, r- �parse_name_and_versionc s
rE c C s� t � }t | pg �} t |pg �}d| kr8| �d� ||O }| D ]x}|dkrT|�|� q<|�d�r�|dd � }||kr�t�d| � ||kr�|�|� q<||kr�t�d| � |�|� q<|S )N�*r; r zundeclared extra: %s)r� r� r� rT r� r* )Z requestedZ availabler( �rZunwantedr, r, r- �
get_extrasr s&
rH c
C s� i }zNt | �}|�� }|�d�}|�d�s8t�d|� nt�d�|�}t� |�}W n0 t
k
r� } zt� d| |� W 5 d }~X Y nX |S )Nz Content-Typezapplication/jsonz(Unexpected response for JSON request: %sr� z&Failed to get external data for %s: %s) r r� �getrT r� r r� r� r� r� r� � exception)rR r( ZrespZheadersZct�reader�er, r, r- �_get_external_data� s
rM z'https://www.red-dove.com/pypi/projects/c C s* d| d � � | f }tt|�}t|�}|S )Nz%s/%s/project.jsonr ��upperr
�_external_data_base_urlrM )rP rR r( r, r, r- �get_project_data� s
rQ c C s( d| d � � | |f }tt|�}t|�S )Nz%s/%s/package-%s.jsonr rN )rP �versionrR r, r, r- �get_package_data� s
rS c @ s( e Zd ZdZdd� Zdd� Zdd� ZdS ) �Cachez�
A class implementing a cache for resources that need to live in the file system
e.g. shared libraries. This class was moved from resources to here because it
could be used by other modules, e.g. the wheel module.
c C sP t j�|�st �|� t �|�jd@ dkr6t�d|� t j�t j� |��| _
dS )zu
Initialise an instance.
:param base: The base directory where the cache should be located.
�? r z Directory '%s' is not privateN) ra rb r� r+ r� r� r� r* r� �normpathrj )r� rj r, r, r- r� � s
zCache.__init__c C s t |�S )zN
Converts a resource prefix to a directory name in the cache.
)r/ )r� rm r, r, r- �
prefix_to_dir� s zCache.prefix_to_dirc C s� g }t �| j�D ]r}t j�| j|�}z>t j�|�s>t j�|�rJt �|� nt j�|�r`t �
|� W q t k
r� |� |� Y qX q|S )z"
Clear the cache.
)
ra r rj rb r$ r� r� r� r� r r� r� r" )r� Z not_removed�fnr, r, r- �clear� s z Cache.clearN)r� r� r� �__doc__r� rW rY r, r, r, r- rT � s rT c @ s: e Zd ZdZdd� Zddd�Zdd� Zd d
� Zd d � Zd
S )�
EventMixinz1
A very simple publish/subscribe system.
c C s
i | _ d S ru )� _subscribersr� r, r, r- r� � s zEventMixin.__init__Tc C sD | j }||kr t|g�||< n"|| }|r6|�|� n
|�|� dS )a`
Add a subscriber for an event.
:param event: The name of an event.
:param subscriber: The subscriber to be added (and called when the
event is published).
:param append: Whether to append or prepend the subscriber to an
existing subscriber list for the event.
N)r\ r r" �
appendleft)r� �event�
subscriberr" �subsZsqr, r, r- r� � s
zEventMixin.addc C s, | j }||krtd| ��|| �|� dS )z�
Remove a subscriber for an event.
:param event: The name of an event.
:param subscriber: The subscriber to be removed.
zNo subscribers: %rN)r\ r� r� )r� r^ r_ r` r, r, r- r� � s zEventMixin.removec C s t | j�|d��S )z�
Return an iterator for the subscribers for an event.
:param event: The event to return subscribers for.
r, )�iterr\ rI )r� r^ r, r, r- �get_subscribers s zEventMixin.get_subscribersc O sl g }| � |�D ]F}z||f|�|�}W n" tk
rH t�d� d}Y nX |�|� qt�d||||� |S )a^
Publish a event and return a list of values returned by its
subscribers.
:param event: The event to publish.
:param args: The positional arguments to pass to the event's
subscribers.
:param kwargs: The keyword arguments to pass to the event's
subscribers.
z"Exception during event publicationNz/publish %s: args = %s, kwargs = %s, result = %s)rb r� r� rJ r" r )r� r^ �args�kwargsr( r_ r� r, r, r- �publish s
�zEventMixin.publishN)T) r� r� r� rZ r� r� r� rb re r, r, r, r- r[ � s
r[ c @ s^ e Zd Zdd� Zdd� Zddd�Zdd � Zd
d � Zd d
� Zdd� Z e
dd� �Z e
dd� �Z dS )� Sequencerc C s i | _ i | _t� | _d S ru )�_preds�_succsr� �_nodesr� r, r, r- r� " s zSequencer.__init__c C s | j �|� d S ru )ri r� �r� �noder, r, r- �add_node' s zSequencer.add_nodeFc C s� || j kr| j �|� |r�t| j�|d��D ]}| �||� q,t| j�|d��D ]}| �||� qPt| j�� �D ]\}}|sp| j|= qpt| j�� �D ]\}}|s�| j|= q�d S )Nr, )ri r� r� rg rI rh r r� )r� rk Zedgesr} r+ r� rI r, r, r- � remove_node* s
zSequencer.remove_nodec C s< ||ks t �| j�|t� ��|� | j�|t� ��|� d S ru )rd rg �
setdefaultr� r� rh )r� �pred�succr, r, r- r� : s z
Sequencer.addc C s� ||ks t �z| j| }| j| }W n tk
rD td| ��Y nX z|�|� |�|� W n$ tk
r� td||f ��Y nX d S )Nz %r not a successor of anythingz%r not a successor of %r)rd rg rh �KeyErrorr� r� )r� ro rp �predsZsuccsr, r, r- r� ? s
zSequencer.removec C s || j kp || jkp || jkS ru )rg rh ri )r� �stepr, r, r- �is_stepL s �zSequencer.is_stepc C s� | � |�std| ��g }g }t� }|�|� |r�|�d�}||krb||kr�|�|� |�|� q.|�|� |�|� | j�|d�}|� |� q.t
|�S )Nz Unknown: %rr r, ) rt r� r� r" rh r� r� rg rI �extend�reversed)r� �finalr( Ztodo�seenrs rr r, r, r- � get_stepsP s"
zSequencer.get_stepsc sR dg�g �i �i �g �| j � � ������fdd��� D ]}|�kr8�|� q8�S )Nr c s� �d �| < �d �| < �d d7 < �� | � z � | }W n tk
rV g }Y nX |D ]J}|�kr��|� t�| �| ��| < q\|�kr\t�| �| ��| < q\�| �| kr�g }��� }|� |� || kr�q�q�t|�}�� |� d S )Nr r )r" r� �minrh �tuple)rk Z
successorsZ successorZconnected_componentZ component�Zgraph�indexZ
index_counterZlowlinksr( �stack�
strongconnectr, r- r t s,
z3Sequencer.strong_connections..strongconnect)rh rj r, r| r- �strong_connectionsi s "
z Sequencer.strong_connectionsc C sf dg}| j D ]*}| j | }|D ]}|�d||f � q q | jD ]}|�d| � q>|�d� d�|�S )Nz digraph G {z %s -> %s;z %s;�}�
)rg r" ri r$ )r� r( rp rr ro rk r, r, r- �dot� s
z
Sequencer.dotN)F)
r� r� r� r� rl rm r� r� rt ry �propertyr� r� r, r, r, r- rf ! s
2rf )�.tar.gz�.tar.bz2�.tar�.zip�.tgz�.tbz�.whlTc sZ � �fdd�}t j�� �� t� ��d }|d kr�| �d�r>d}nH| �d�rRd}d}n4| �d�rfd }d
}n | �d �rzd }d
}n td| ��z�|dkr�t| d
�}|r�|�� }|D ] }||� q�n*t �
| |�}|r�|� � }|D ] }||� q�|dk�r*t j
d dk �r*|�� D ]"} t| jt��s| j�d�| _�qdd� }
|
|_|�� � W 5 |�rT|�� X d S )Nc sR t | t�s| �d�} tj�tj�� | ��}|�� �rB|� tjkrNt d| ��d S )Nr� z path outside destination: %r)
rx r �decodera rb r� r$ rT rc r� )rb r} ��dest_dirZplenr, r- �
check_path� s
z unarchive..check_path)r� r� �zip)r� r� Ztgzzr:gz)r� r� Ztbzzr:bz2r� ZtarrG zUnknown format for %rr r� r� c
S sD zt �| |�W S t jk
r> } ztt|���W 5 d}~X Y nX dS )z:Run tarfile.tar_fillter, but raise the expected ValueErrorN)�tarfileZ
tar_filterZ FilterErrorr� �str)�memberrb �excr, r, r- �extraction_filter� s z$unarchive..extraction_filter)ra rb r� re r0 r� r� r Znamelistr� r� Zgetnamesrq r� Z
getmembersrx rP r r� r� Z
extractall) Zarchive_filenamer� �formatr� r� �archiver� �namesrP Ztarinfor� r, r� r- � unarchive� sL
r� c C s~ t �� }t| �}t|d��Z}t�| �D ]H\}}}|D ]8}tj�||�}||d� } tj�| |�}
|�||
� q4q&W 5 Q R X |S )z*zip a directory tree into a BytesIO objectr� N) �io�BytesIOre r ra �walkrb r$ r� ) Z directoryr( ZdlenZzfrf r r� rP ZfullZrelrl r, r, r- �zip_dir� s r� )r �K�M�G�T�Pc @ sr e Zd ZdZddd�Zdd� Zdd � Zd
d � Zd d
� Ze dd� �Z
e dd� �Z dd� Z e dd� �Z
e dd� �ZdS )�ProgressZUNKNOWNr �d c C s< |d ks||kst �| | _| _|| _d | _d| _d| _d S )Nr F)rd rz �cur�max�started�elapsed�done)r� ZminvalZmaxvalr, r, r- r� s zProgress.__init__c C sV | j |kst�| jd ks&|| jks&t�|| _t�� }| jd krF|| _n || j | _d S ru )rz rd r� r� �timer� r� )r� ZcurvalZnowr, r, r- �update s
zProgress.updatec C s |dks t �| �| j| � d S �Nr )rd r� r� )r� Zincrr, r, r- � increment s zProgress.incrementc C s | � | j� | S ru )r� rz r� r, r, r- r= s zProgress.startc C s | j d k r| �| j � d| _d S )NT)r� r� r� r� r, r, r- �stop# s
z
Progress.stopc C s | j d kr| jS | j S ru )r� �unknownr� r, r, r- �maximum( s zProgress.maximumc C sD | j r d}n4| jd kr d}n$d| j| j | j| j }d| }|S )Nz100 %z ?? %g Y@z%3d %%)r� r� r� rz )r� r( rI r, r, r- �
percentage, s
zProgress.percentagec C s: |dkr| j d ks | j| jkr$d}nt�dt�|��}|S )Nr z??:??:??z%H:%M:%S)r� r� rz r� �strftime�gmtime)r� Zdurationr( r, r, r- �format_duration7 s zProgress.format_durationc C s� | j rd}| j}n^d}| jd kr&d}nJ| jdks<| j| jkrBd}n.t| j| j �}|| j| j }|d | j }d|| �|�f S )NZDonezETA r� r r z%s: %s)r� r� r� r� rz �floatr� )r� rm r\ r, r, r- �ETA@ s
z Progress.ETAc C sL | j dkrd}n| j| j | j }tD ]}|dk r6 q@|d }q&d||f S )Nr g i� g @�@z%d %sB/s)r� r� rz �UNITS)r� r( Zunitr, r, r- �speedS s
zProgress.speedN)r r� )r� r� r� r� r� r� r� r= r� r� r� r� r� r� r� r, r, r, r- r� s
r� z \{([^}]*)\}z[^/\\,{]\*\*|\*\*[^/\\,}]z^[^{]*\}|\{[^}]*$c C s< t �| �rd}t|| ��t�| �r4d}t|| ��t| �S )zAExtended globbing function that supports ** and {opt1,opt2,opt3}.z7invalid glob %r: recursive glob "**" must be used alonez2invalid glob %r: mismatching set marker '{' or '}')�_CHECK_RECURSIVE_GLOBr! r� �_CHECK_MISMATCH_SET�_iglob)� path_globr� r, r, r- r h s
r c c s t �| d�}t|�dkrht|�dks,t|��|\}}}|�d�D ]$}td�|||f��D ]
}|V qXq@n�d| kr�t| �D ]
}|V qxn~| �dd�\}}|dkr�d}|dkr�d}n|�d�}|�d �}t� |�D ]4\}}} tj
� |�}ttj
�||��D ]
}
|
V q�q�d S )
Nr r� rC r z**r rF r` �\) � RICH_GLOBr� re rd r� r$ � std_iglobr% ra r� rb rV ) r� Zrich_path_globrm r� rk �itemrb Zradical�dirr� rX r, r, r- r� s s*
r� )� HTTPSHandler�match_hostname�CertificateErrorc @ s e Zd ZdZdZdd� ZdS )�HTTPSConnectionNTc C sR t �| j| jf| j�}t| dd�r0|| _| �� tt d�sp| j
rHt j }nt j }t j
|| j| j|t j| j
d�| _nxt �t j�}| jt jO _| jr�|�| j| j� i }| j
r�t j |_|j| j
d� tt dd�r�| j|d< |j
|f|�| _| j
�rN| j�rNz$t| j�� | j� t�d| j� W n0 t k
�rL | j� t j � | j� � � Y nX d S ) NZ _tunnel_hostF�
SSLContext)� cert_reqsZ ssl_version�ca_certs)ZcafileZHAS_SNIZserver_hostnamezHost verified: %s) r� Zcreate_connection�host�port�timeoutrr �sockZ_tunnelrp �sslr� Z
CERT_REQUIREDZ CERT_NONEZ wrap_socketZkey_fileZ cert_fileZPROTOCOL_SSLv23r� ZoptionsZ OP_NO_SSLv2Zload_cert_chainZ verify_modeZload_verify_locations� check_domainr� Z getpeercertr� r r� ZshutdownZ SHUT_RDWRr� )r� r� r� �contextrd r, r, r- �connect� s@
�
zHTTPSConnection.connect)r� r� r� r� r� r� r, r, r, r- r� � s r� c @ s& e Zd Zd dd�Zdd� Zdd� ZdS )
r� Tc C s t �| � || _|| _d S ru )�BaseHTTPSHandlerr� r� r� )r� r� r� r, r, r- r� � s
zHTTPSHandler.__init__c O s$ t ||�}| jr | j|_| j|_|S )a
This is called to create a connection instance. Normally you'd
pass a connection class to do_open, but it doesn't actually check for
a class, and just expects a callable. As long as we behave just as a
constructor would have, we should be OK. If it ever changes so that
we *must* pass a class, we'll create an UnsafeHTTPSConnection class
which just sets check_domain to False in the class definition, and
choose which one to pass to do_open.
)r� r� r� )r� rc rd r( r, r, r- � _conn_maker� s
zHTTPSHandler._conn_makerc
C sX z| � | j|�W S tk
rR } z$dt|j�kr@td|j ��n� W 5 d }~X Y nX d S )Nzcertificate verify failedz*Unable to verify server certificate for %s)Zdo_openr� r r� �reasonr� r� )r� rY rL r, r, r- �
https_open� s �zHTTPSHandler.https_openN)T)r� r� r� r� r� r� r, r, r, r- r� � s
r� c @ s e Zd Zdd� ZdS )�HTTPSOnlyHandlerc C s t d| ��d S )NzAUnexpected HTTP request on what should be a secure connection: %s)r )r� rY r, r, r- � http_open� s �zHTTPSOnlyHandler.http_openN)r� r� r� r� r, r, r, r- r� � s r� � �r� � c @ s e Zd Zddd�ZdS )�HTTPr Nc K s& |dkr d }| � | j||f|�� d S r� ��_setupZ_connection_class�r� r� r� rd r, r, r- r� � s z
HTTP.__init__)r N�r� r� r� r� r, r, r, r- r� � s r� c @ s e Zd Zddd�ZdS )�HTTPSr Nc K s& |dkr d }| � | j||f|�� d S r� r� r� r, r, r- r� � s zHTTPS.__init__)r Nr� r, r, r, r- r� � s r� c @ s e Zd Zddd�Zdd� ZdS )� Transportr c C s || _ tj�| |� d S ru )r� r r� r� �r� r� � use_datetimer, r, r- r� s zTransport.__init__c C s` | � |�\}}}tdkr(t|| jd�}n4| jr<|| jd krR|| _|t�|�f| _| jd }|S )Nr� )r� r r )�
get_host_info� _ver_infor� r� � _connection�_extra_headersr ZHTTPConnection)r� r� �h�ehZx509r( r, r, r- �make_connection
s
zTransport.make_connectionN)r �r� r� r� r� r� r, r, r, r- r� s
r� c @ s e Zd Zddd�Zdd� ZdS )�
SafeTransportr c C s || _ tj�| |� d S ru )r� r r� r� r� r, r, r- r� s zSafeTransport.__init__c C sx | � |�\}}}|si }| j|d< tdkr:t|d f|�}n:| jrN|| jd krj|| _|tj|d f|�f| _| jd }|S )Nr� r� r r )r� r� r� r� r� r� r r� )r� r� r� r� rd r( r, r, r- r� s
�
z SafeTransport.make_connectionN)r r� r, r, r, r- r� s
r� c @ s e Zd Zdd� ZdS )� ServerProxyc K st |� dd � | _}|d k r^t|�\}}|�dd�}|dkr@t}nt}|||d� |d< }|| _tjj | |f|� d S )Nr� r� r Zhttps)r� � transport)
rh r� r rI r� r� r� r r� r� ) r� rZ rd r� rW r] r� Ztclsr\ r, r, r- r� , s zServerProxy.__init__Nr� r, r, r, r- r� + s r� c K s6 t jd dk r|d7 }nd|d< d|d< t| |f|�S )Nr r� �br �newliner� r� )rq r� r� )rX r� rd r, r, r- � _csv_open@ s
r� c @ s4 e Zd Zed�ed�ed�d�Zdd� Zdd� Zd S )
�CSVBaserC �"r� )Z delimiterZ quotecharZlineterminatorc C s | S ru r, r� r, r, r- � __enter__R s zCSVBase.__enter__c G s | j �� d S ru )r� r� )r� r& r, r, r- �__exit__U s zCSVBase.__exit__N)r� r� r� r� �defaultsr� r� r, r, r, r- r� K s �r� c @ s( e Zd Zdd� Zdd� Zdd� ZeZdS )� CSVReaderc K s\ d|kr4|d }t jd dkr,t�d�|�}|| _nt|d d�| _tj| jf| j�| _d S )Nr� r r� r� rb rG ) rq r� r� r� r� r� �csvrK r� )r� rd r� r, r, r- r� Z s zCSVReader.__init__c C s | S ru r, r� r, r, r- �__iter__e s zCSVReader.__iter__c C sF t | j�}tjd dk rBt|�D ] \}}t|t�s |�d�||< q |S �Nr r� r� )�nextrK rq r� r7 rx r r� )r� r( r[ r� r, r, r- r� h s
zCSVReader.nextN)r� r� r� r� r� r� �__next__r, r, r, r- r� Y s r� c @ s e Zd Zdd� Zdd� ZdS )� CSVWriterc K s$ t |d�| _tj| jf| j�| _d S )Nr� )r� r� r� �writerr� )r� rX rd r, r, r- r� s s zCSVWriter.__init__c C sN t jd dk r>g }|D ]"}t|t�r.|�d�}|�|� q|}| j�|� d S r� )rq r� rx r r� r" r� �writerow)r� �rowrG r� r, r, r- r� w s
zCSVWriter.writerowN)r� r� r� r� r� r, r, r, r- r� r s r� c sH e Zd Zeej�Zded< d � fdd� Zdd� Zdd � Zd
d � Z � Z
S )
� Configurator� inc_convertZincNc s" t t| ��|� |pt�� | _d S ru )�superr r� ra r� rj )r� �configrj �� __class__r, r- r� � s zConfigurator.__init__c
s� ��fdd��� � d�}t|�s*��|�}� � dd �}� � dd�}|r\t�fdd�|D ��}� �fd d�� D �}t|�}|||�}|r�|�� D ]\}} t||�| �� q�|S )
Nc sv t | ttf�r*t| �� fdd�| D ��}nHt | t�rhd| krH��| �}qri }| D ]}� | | �||< qPn
��| �}|S )Nc s g | ] }� |��qS r, r, )rN r[ ��convertr, r- rO � s zBConfigurator.configure_custom..convert..�())rx r r{ �type�dict�configure_customr )�or( r� )r r� r, r- r � s
z.Configurator.configure_custom..convertr r z[]r, c s g | ] }� |��qS r, r, )rN r r r, r- rO � s z1Configurator.configure_custom..c s$ g | ] }t |�r|�� | �f�qS r, )r )rN r� )r r r, r- rO � s )rh r r r{ r
r� �setattr)
r� r r~ Zpropsrc r� rd r( rB rI r, )r r r� r- r � s
z Configurator.configure_customc C s4 | j | }t|t�r0d|kr0| �|� | j |< }|S )Nr )r rx r
r )r� r� r( r, r, r- � __getitem__� s
zConfigurator.__getitem__c C sF t j�|�s t j�| j|�}tj|ddd��}t�|�}W 5 Q R X |S )z*Default converter for the inc:// protocol.rG r� r� ) ra rb �isabsr$ rj r� r� r� r� )r� r� r� r( r, r, r- r � s
zConfigurator.inc_convert)N) r� r� r� r
r Zvalue_convertersr� r r r �
__classcell__r, r, r r- r � s
r c @ s* e Zd ZdZd
dd�Zdd� Zdd � ZdS ) �SubprocessMixinzC
Mixin for running subprocesses and capturing their output
FNc C s || _ || _d S ru )�verbose�progress)r� r r r, r, r- r� � s zSubprocessMixin.__init__c C sj | j }| j}|�� }|sq^|dk r.|||� q |s@tj�d� ntj�|�d�� tj�� q |�� dS )z�
Read lines from a subprocess' output stream and either pass to a progress
callable (if specified) or write progress information to sys.stderr.
Nr r� ) r r �readlinerq �stderrr� r� �flushr� )r� r� r� r r r+ r, r, r- rK � s zSubprocessMixin.readerc K s� t j|ft jt jd�|��}tj| j|jdfd�}|�� tj| j|jdfd�}|�� |� � |�
� |�
� | j d k r�| � dd� n| j r�t
j�d� |S )N)�stdoutr r )r� rc r zdone.�mainzdone.
)�
subprocess�Popen�PIPE� threadingZThreadrK r r= r �waitr$ r r rq r� )r� �cmdrd r} �t1�t2r, r, r- � run_command� s" ��
zSubprocessMixin.run_command)FN)r� r� r� rZ r� rK r! r, r, r, r- r � s
r c C s t �dd| ��� S )z,Normalize a python package name a la PEP 503z[-_.]+r; )r> �subrz )rP r, r, r- �normalize_name� s r# )NN)r� )N)N)NT)�r� � collectionsr �
contextlibr� Zglobr r� r� r� Zloggingra r� r> r� r� � ImportErrorr rq r� r� r� r Zdummy_threadingr� r r �compatr r r r r
r r r
r r r r r r r r r r r r r Z getLoggerr� r� r� r rG rF r6 r> r: rV r# r? r^ rn rt ry r r� r� r� �contextmanagerr� r� r� r� r� r� r� r r �VERBOSEr r� r- r/ r1 r3 r6 r9 �Ir@ r< rC rD rE rH rM rP rQ rS rT r[ rf ZARCHIVE_EXTENSIONSr� r� r� r� r� r� r� r� r� r� r� r� r� r� r� r� r� r� r� r� r� r� r� r� r� r r r# r, r, r, r- � s�
\
Yy
/
8 �
)
�
,H
C]
*)
7.