a
XC?h� � @ s� d Z dZddlZddlmZmZmZmZmZm Z ddl
m Z ddl
m Z G dd � d e
�Zd
d � ZG d d
� d
e�Zejejejdd�Zdd� Zdd� Zdd� ZdS )z�Pattern compiler.
The grammar is taken from PatternGrammar.txt.
The compiler compiles a pattern to a pytree.*Pattern instance.
z#Guido van Rossum � N� )�driver�literals�token�tokenize�parse�grammar)�pytree)�pygramc @ s e Zd ZdS )�PatternSyntaxErrorN)�__name__�
__module__� __qualname__� r r �4/opt/alt/python39/lib64/python3.9/lib2to3/patcomp.pyr s r c c sL t jt jt jh}t�t�| �j�}|D ] }|\}}}}}||vr&|V q&dS )z6Tokenizes a string suppressing significant whitespace.N) r �NEWLINE�INDENT�DEDENTr �generate_tokens�io�StringIO�readline) �input�skip�tokensZ quintuple�type�value�start�endZ line_textr r r �tokenize_wrapper s r c @ s: e Zd Zd
dd�Zddd�Zdd� Zdd d
�Zd d � ZdS )�PatternCompilerNc C sZ |du rt j| _t j| _nt�|�| _t �| j�| _t j| _ t j
| _ tj | jt
d�| _dS )z^Initializer.
Takes an optional alternative filename for the pattern grammar.
N)Zconvert)r
Zpattern_grammarr Zpattern_symbols�symsr Z load_grammarZSymbolsZpython_grammarZ pygrammarZpython_symbols�pysymsZDriver�pattern_convert)�selfZ grammar_filer r r �__init__( s
zPatternCompiler.__init__Fc
C sr t |�}z| jj||d�}W n4 tjyP } ztt|��d�W Y d}~n
d}~0 0 |rd| �|�|fS | �|�S dS )z=Compiles a pattern string to a nested pytree.*Pattern object.)�debugN)r r Z parse_tokensr Z
ParseErrorr �str� compile_node)r$ r r& Z with_treer �root�er r r �compile_pattern7 s $z PatternCompiler.compile_patternc
sV |j � jjkr|jd }|j � jjkrz� fdd�|jddd� D �}t|�dkrX|d S tjdd� |D �ddd�}|�� S |j � jj krʇ fd d�|jD �}t|�dkr�|d S tj|gddd�}|�� S |j � jj
kr�� � |jdd� �}t� |�}|�� S d}|j}t|�d
k�r>|d j t
jk�r>|d j}|dd� }d}t|�dk�rx|d j � jjk�rx|d }|dd � }� � ||�}|du�r>|j} | d }
|
j t
jk�r�d} tj} nX|
j t
jk�r�d} tj} n>|
j t
jk�r� �| d � } } t| �d k�r� �| d
�} n | dk�s"| dk�r>|�� }tj|gg| | d�}|du�rN||_|�� S )
zXCompiles a node, recursively.
This is one big switch on the node type.
r c s g | ]}� � |��qS r �r( ��.0Zch�r$ r r �
O � z0PatternCompiler.compile_node..N� r c S s g | ]
}|g�qS r r )r. �ar r r r0 R r1 ��min�maxc s g | ]}� � |��qS r r, r- r/ r r r0 V r1 � ������ )r r! ZMatcher�childrenZ Alternatives�lenr �WildcardPattern�optimizeZ AlternativeZ NegatedUnit�
compile_basicZNegatedPatternr �EQUALr ZRepeater�STARZHUGE�PLUS�LBRACE�get_int�name)
r$ �nodeZalts�pZunits�patternrD �nodes�repeatr: �childr5 r6 r r/ r r( C s^
"
z PatternCompiler.compile_nodec C s@ |d }|j tjkr4tt�|j��}t�t |�|�S |j tj
kr�|j}|� � r�|t vrbt
d| ��|dd � rvt
d��t�t | �S |dkr�d }n,|�d�s�t| j|d �}|d u r�t
d| ��|dd � r�| �|d jd �g}nd }t�||�S nH|jdk�r| �|d �S |jd k�r<| �|d �}tj|ggddd
�S d S ) Nr zInvalid token: %rr z Can't have details for token�any�_zInvalid symbol: %r�(�[r4 )r r �STRINGr' r Z
evalStringr r Z LeafPattern�_type_of_literal�NAME�isupper� TOKEN_MAPr �
startswith�getattrr" r( r: Z NodePatternr< )r$ rH rI rE r r Zcontent�
subpatternr r r r> � s8
z PatternCompiler.compile_basicc C s
t |j�S �N)�intr )r$ rE r r r rC � s zPatternCompiler.get_int)N)FF)N)r r
r r% r+ r( r> rC r r r r r & s
G
#r )rQ rO �NUMBERZTOKENc C s. | d � � rtjS | tjv r&tj| S d S d S )Nr )�isalphar rQ r Zopmap)r r r r rP � s
rP c C s> |\}}}}|s|| j v r*tj|||d�S tj|||d�S dS )z9Converts raw node information to a Node or Leaf instance.)�contextN)Z
number2symbolr ZNodeZLeaf)r Z
raw_node_infor r r[ r: r r r r# � s r# c C s t � �| �S rW )r r+ )rG r r r r+ � s r+ )�__doc__�
__author__r Zpgen2r r r r r r � r r
� Exceptionr r �objectr rQ rO rY rS rP r# r+ r r r r � s"
�