File: //kunden/lib/python3/dist-packages/dulwich/__pycache__/greenthreads.cpython-39.pyc
a
�~�_� � @ sj d Z ddlZddlmZ ddlmZmZ ddlmZmZm Z d
dd�Z
G d d
� d
e�Z G d d � d e �Z dS )z7Utility module for querying an ObjectStore with gevent.� N)�pool)�Commit�Tag)�MissingObjectFinder�_collect_filetree_revs�ObjectStoreIteratorFc sD t � � t � �� ���fdd����fdd�|D �}t�|� � �fS )z�Split object id list into two list with commit SHA1s and tag SHA1s.
Same implementation as object_store._split_commits_and_tags
except we use gevent to parallelize object retrieval.
c sr z �| }W n t y$ �s � Y nJ0 t|t�r<� �| � n2t|t�rb��| � � �|jd � n t d| ��d S )N� zNot a commit or a tag: %s)�KeyError�
isinstancer �addr �object)�sha�o)�commits�ignore_unknown� obj_store�tags� �6/usr/lib/python3/dist-packages/dulwich/greenthreads.py�find_commit_type1 s
z1_split_commits_and_tags.<locals>.find_commit_typec s g | ]}�� � |��qS r ��spawn)�.0�s)r r r r �
<listcomp>? � z+_split_commits_and_tags.<locals>.<listcomp>)�set�gevent�joinall)r Zlstr r �jobsr )r r r r r r r �_split_commits_and_tags' s
r c @ s e Zd ZdZddd�ZdS )� GreenThreadsMissingObjectFinderz�Find the objects missing from another object store.
Same implementation as object_store.MissingObjectFinder
except we use gevent to parallelize object retrieval.
Nr c s� ��fdd�� ��_ tj|d��t�|d��\}} t�|d��\}
} ��|�d } ��|
| �\}
}t� �_� �fdd�|D �}t�|� | D ]}�j� |� q�| �
| �}|
� |�}td d� |D ���_ |d u r�d
d � �_
n|�_
|r�|� p�i �_d S ) Nc s( �j �| � � | }t� |j�j � d S �N)�sha_doner r Ztree)r
Zcmt)� object_store�selfr r �collect_tree_shaN s zBGreenThreadsMissingObjectFinder.__init__.<locals>.collect_tree_sha��sizeTFr c s g | ]}�� � |��qS r r )r �c)r& �pr r r a r z<GreenThreadsMissingObjectFinder.__init__.<locals>.<listcomp>c S s g | ]}|d df�qS )NFr )r �wr r r r g r c S s d S r" r )�xr r r �<lambda>i r z:GreenThreadsMissingObjectFinder.__init__.<locals>.<lambda>)r$ r �Poolr Z_collect_ancestorsr r# r r r �
difference�union�objects_to_send�progressZ_tagged)r% r$ ZhavesZwantsr2 Z
get_tagged� concurrencyZ get_parentsZ have_commitsZ have_tagsZ want_commitsZ want_tagsZ
all_ancestorsZmissing_commitsZcommon_commitsr �tZ missing_tagsr )r& r$ r* r% r �__init__J s4 ����
�
z(GreenThreadsMissingObjectFinder.__init__)NNr N)�__name__�
__module__� __qualname__�__doc__r5 r r r r r! D s �r! c s: e Zd ZdZd � fdd� Zdd� Zdd� Zd d
� Z� ZS ) � GreenThreadsObjectStoreIteratorz�ObjectIterator that works on top of an ObjectStore.
Same implementation as object_store.ObjectStoreIterator
except we use gevent to parallelize object retrieval.
r c s* || _ tj|d�| _tt| ��||� d S )Nr' )�finderr r. r* �superr: r5 )r% �storeZshasr; r3 �� __class__r r r5 u s z(GreenThreadsObjectStoreIterator.__init__c C s |\}}| j | |fS r" )r= )r% �argsr
�pathr r r �retrievez s z(GreenThreadsObjectStoreIterator.retrievec c s, | j �| j| �� �D ]\}}||fV qd S r" )r* Zimap_unorderedrB Zitershas)r% r
rA r r r �__iter__~ s
� z(GreenThreadsObjectStoreIterator.__iter__c C s� t | j�dkrt | j�S t | jj�r�g }tdt | jj��D ]}|�| j�| jj�� q:t �
|� |D ] }|j d urd| j�|j � qdqt | j�S )Nr ) �lenZ_shasr; r1 �range�appendr* r �nextr r �value)r% r �_�jr r r �__len__� s
z'GreenThreadsObjectStoreIterator.__len__)r ) r6 r7 r8 r9 r5 rB rC rK �
__classcell__r r r> r r: o s
r: )FN)
r9 r r Zdulwich.objectsr r Zdulwich.object_storer r r r r! r: r r r r �<module> s �
+