a
XC?h� � @ s� d Z ddlZddlmZmZmZmZmZmZ ddl m
Z
ddl m Z G dd� de �Z
d d
� ZG d d � d e�Zejejejdd
�Zdd� Zdd� Zdd� ZdS )z#Guido van Rossum � N� )�driver�literals�token�tokenize�parse�grammar)�pytree)�pygramc @ s e Zd ZdS )�PatternSyntaxErrorN)�__name__�
__module__� __qualname__� r r �4/opt/alt/python39/lib64/python3.9/lib2to3/patcomp.pyr s r c c sL t jt jt jh}t�t�| �j�}|D ] }|\}}}}}||vr&|V q&d S �N) r �NEWLINE�INDENT�DEDENTr �generate_tokens�io�StringIO�readline) �input�skip�tokensZ quintuple�type�value�start�endZ line_textr r r �tokenize_wrapper s r c @ s: e Zd Zd
dd�Zddd�Zdd� Zdd d
�Zd d � ZdS )�PatternCompilerNc C sZ |d u rt j| _t j| _nt�|�| _t �| j�| _t j| _ t j
| _ tj | jt
d�| _d S )N)Zconvert)r
Zpattern_grammarr Zpattern_symbols�symsr Z load_grammarZSymbolsZpython_grammarZ pygrammarZpython_symbols�pysymsZDriver�pattern_convert)�selfZ grammar_filer r r �__init__( s
zPatternCompiler.__init__Fc
C sr t |�}z| jj||d�}W n4 tjyP } ztt|��d �W Y d }~n
d }~0 0 |rd| �|�|fS | �|�S d S )N)�debug)r r Z parse_tokensr Z
ParseErrorr �str� compile_node)r% r r' Z with_treer �root�er r r �compile_pattern7 s $z PatternCompiler.compile_patternc
sV |j � jjkr|jd }|j � jjkrz� fdd�|jd d d� D �}t|�dkrX|d S tjdd� |D �ddd�}|�� S |j � jj krʇ fdd�|jD �}t|�dkr�|d S tj|gddd�}|�� S |j � jj
kr�� � |jdd � �}t� |�}|�� S d }|j}t|�d k�r>|d j t
jk�r>|d j}|dd � }d }t|�dk�rx|d
j � jjk�rx|d
}|d d
� }� � ||�}|d u�r>|j} | d }
|
j t
jk�r�d} tj} nX|
j t
jk�r�d} tj} n>|
j t
jk�r� �| d � } } t| �d k�r� �| d �} n | dk�s"| dk�r>|�� }tj|gg| | d�}|d u�rN||_|�� S ) Nr c s g | ]}� � |��qS r �r) ��.0Zch�r% r r �
O � z0PatternCompiler.compile_node..� r c S s g | ]
}|g�qS r r )r/ �ar r r r1 R r2 ��min�maxc s g | ]}� � |��qS r r- r. r0 r r r1 V r2 � ������ )r r" ZMatcher�childrenZ Alternatives�lenr �WildcardPattern�optimizeZ AlternativeZ NegatedUnit�
compile_basicZNegatedPatternr �EQUALr ZRepeater�STARZHUGE�PLUS�LBRACE�get_int�name)
r% �nodeZalts�pZunits�patternrE �nodes�repeatr; �childr6 r7 r r0 r r) C s^
"
z PatternCompiler.compile_nodec C s@ |d }|j tjkr4tt�|j��}t�t |�|�S |j tj
kr�|j}|� � r�|t vrbt
d| ��|dd � rvt
d��t�t | �S |dkr�d }n,|�d�s�t| j|d �}|d u r�t
d| ��|dd � r�| �|d jd �g}nd }t�||�S nH|jdk�r| �|d �S |jd k�r<| �|d �}tj|ggddd
�S d S ) Nr zInvalid token: %rr z Can't have details for token�any�_zInvalid symbol: %r�(�[r5 )r r �STRINGr( r Z
evalStringr r Z LeafPattern�_type_of_literal�NAME�isupper� TOKEN_MAPr �
startswith�getattrr# r) r; Z NodePatternr= )r% rI rJ rF r r Zcontent�
subpatternr r r r? � s8
z PatternCompiler.compile_basicc C s
t |j�S r )�intr )r% rF r r r rD � s zPatternCompiler.get_int)N)FF)N)r r
r r& r, r) r? rD r r r r r! & s
G
#r! )rR rP �NUMBERZTOKENc C s. | d � � rtjS | tjv r&tj| S d S d S )Nr )�isalphar rR r Zopmap)r r r r rQ � s
rQ c C s> |\}}}}|s|| j v r*tj|||d�S tj|||d�S d S )N)�context)Z
number2symbolr ZNodeZLeaf)r Z
raw_node_infor r r[ r; r r r r$ � s r$ c C s t � �| �S r )r! r, )rH r r r r, � s r, )�
__author__r Zpgen2r r r r r r � r r
� Exceptionr r �objectr! rR rP rY rT rQ r$ r, r r r r � s
�