관리-도구
편집 파일: sbcharsetprober.cpython-311.pyc
� �Re� � �j � d dl mZ ddlmZ ddlmZmZmZ edg d�� � Z G d� de� � Z d S ) � )� namedtuple� )� CharSetProber)�CharacterCategory� ProbingState�SequenceLikelihood�SingleByteCharSetModel)� charset_name�language�char_to_order_map�language_model�typical_positive_ratio�keep_ascii_letters�alphabetc �r � � e Zd ZdZdZdZdZd � fd� Z� fd�Ze d � � � Z e d � � � Z d � Z d � Z � xZS )�SingleByteCharSetProber�@ i gffffff�?g�������?FNc �� �� t t | � � � � � || _ || _ || _ d | _ d | _ d | _ d | _ d | _ | � � � d S �N) �superr �__init__�_model� _reversed� _name_prober� _last_order� _seq_counters� _total_seqs� _total_char� _freq_char�reset)�self�model�reversed� name_prober� __class__s ���/builddir/build/BUILDROOT/alt-python311-pip-21.3.1-3.el8.x86_64/opt/alt/python311/lib/python3.11/site-packages/pip/_vendor/chardet/sbcharsetprober.pyr z SingleByteCharSetProber.__init__3 sn �� � �%�t�,�,�5�5�7�7�7��� �!��� '��� ��� !��� ��� ��� ��� � � � � � � � � c �� �� t t | � � � � � d| _ dgt j � � z | _ d| _ d| _ d| _ d S )N� r ) r r r r r �get_num_categoriesr r r r )r! r% s �r& r z SingleByteCharSetProber.resetA s\ �� � �%�t�,�,�2�2�4�4�4� ��� �S�#5�#H�#J�#J� J��� ��� �������r' c �@ � | j r | j j S | j j S r )r r r �r! s r& r z$SingleByteCharSetProber.charset_nameK s$ � � � � ,��$�1� 1��;�+� +r' c �@ � | j r | j j S | j j S r )r r r r, s r& r z SingleByteCharSetProber.languageR s$ � � � � (��$�-� -��;�'� 'r' c � � | j j s| � |� � }|s| j S | j j }| j j }|D ]�}|� |t j � � }|t j k r| xj dz c_ || j k rs| xj dz c_ | j | j k rS| xj dz c_ | j s|| j | }n|| | j }| j |xx dz cc< || _ ��| j j }| j t$ j k r�| j | j k r�| � � � }|| j k r.| j � d||� � t$ j | _ n>|| j k r3| j � d||| j � � t$ j | _ | j S )Nr z$%s confidence = %s, we have a winnerz9%s confidence = %s, below negative shortcut threshhold %s) r r �filter_international_words�stater r �getr � UNDEFINED�CONTROLr � SAMPLE_SIZEr r r r r r r � DETECTING�SB_ENOUGH_REL_THRESHOLD�get_confidence�POSITIVE_SHORTCUT_THRESHOLD�logger�debug�FOUND_IT�_state�NEGATIVE_SHORTCUT_THRESHOLD�NOT_ME) r! �byte_strr r �char�order�lm_catr � confidences r& �feedz SingleByteCharSetProber.feedY s � ��{�-� A��6�6�x�@�@�H�� ��:� � �K� 9�� ��3�� � %� %�D�%�)�)�$�0A�0K�L�L�E� �(�0�0�0�� � �A�%� � � �t�'�'�'����1�$����#�d�&6�6�6��$�$��)�$�$� �>� I�!/��0@�!A�%�!H���!/��!6�t�7G�!H���&�v�.�.�.�!�3�.�.�.� $�D� � ��{�/� � �:� �/� /� /�� �$�">�>�>� !� 0� 0� 2� 2� � �� @�@�@��K�%�%�&L�&2�J�@� @� @�".�"7�D�K�K� �$�"B�B�B��K�%�%� '?�@L�&0�&*�&F�H� H� H� #/�"5�D�K��z�r' c � � d}| j dk rId| j t j z | j z | j j z }|| j z | j z }|dk rd}|S )Ng{�G�z�?r g �?g�G�z��?)r r r �POSITIVEr r r r )r! �rs r& r7 z&SingleByteCharSetProber.get_confidence� sk � � �� � �a� � ���*�+=�+F�G�G��!�"�$(�K�$F�G�A��D�O�#�d�&6�6�A��C�x�x����r' )FN)�__name__� __module__� __qualname__r4 r6 r8 r= r r �propertyr r rD r7 � __classcell__)r% s @r& r r - s� �� � � � � ��K� "��"&� �"&� � � � � � � � � � � � � �,� ,� �X�,� �(� (� �X�(� .� .� .�`� � � � � � r' r N) � collectionsr � charsetproberr �enumsr r r r r � r' r& �<module>rQ s� ��: #� "� "� "� "� "� (� (� (� (� (� (� F� F� F� F� F� F� F� F� F� F� $��$<�%1� %1� %1�2� 2� �d� d� d� d� d�m� d� d� d� d� dr'