o Ďi<@sddlZddlZddlmZddlmZddlmZmZm Z m Z ddl m Z m Z mZmZGddde ZGdd d e ZGd d d e ZdS) N) ClientError)S3CopyFailedError)CompleteMultipartUploadTaskCreateMultipartUploadTaskSubmissionTaskTask)ChunksizeAdjustercalculate_range_parameter get_callbacksget_filtered_dictc @sxeZdZdZdddddddd d d Zgd Zgd ZgdZddZddZ ddZ ddZ ddZ ddZ ddZdS)CopySubmissionTaskz+Task for submitting tasks to execute a copyIfMatchIfModifiedSince IfNoneMatchIfUnmodifiedSinceSSECustomerKeySSECustomerAlgorithmSSECustomerKeyMD5 RequestPayerExpectedBucketOwner) CopySourceIfMatchCopySourceIfModifiedSinceCopySourceIfNoneMatchCopySourceIfUnmodifiedSinceCopySourceSSECustomerKeyCopySourceSSECustomerAlgorithmCopySourceSSECustomerKeyMD5rr) rrrrrrrrrrrr) rrrrrrrMetadataDirectiveTaggingDirective)rrrrrc Cs|jjdus |jjdurH|jj}||j}|j}|D]\} } | |jvr-| ||j| <q|j j di|} |j | d|j | d|jj|jkrZ||||||dS||||||dS)a :param client: The client associated with the transfer manager :type config: s3transfer.manager.TransferConfig :param config: The transfer config associated with the transfer manager :type osutil: s3transfer.utils.OSUtil :param osutil: The os utility associated to the transfer manager :type request_executor: s3transfer.futures.BoundedExecutor :param request_executor: The request executor associated with the transfer manager :type transfer_future: s3transfer.futures.TransferFuture :param transfer_future: The transfer future associated with the transfer request that tasks are being submitted for N ContentLengthETag)metasizeetag call_args)_get_head_object_request_from_copy_source copy_source extra_argsitemsEXTRA_ARGS_TO_HEAD_ARGS_MAPPING source_client head_objectprovide_transfer_sizeprovide_object_etaggetmultipart_threshold_submit_copy_request_submit_multipart_request) selfclientconfigosutilrequest_executortransfer_futurer%head_object_requestr(paramvalueresponser!r!M/home/jeff/fluffinator/venv/lib/python3.10/site-packages/s3transfer/copies.py_submitSs:      zCopySubmissionTask._submitc CsL|jj}t|d}|j|t|j||j|j|j|j ||jj ddddS)Nprogress)r4r'bucketkeyr( callbacksr#T)transfer_coordinator main_kwargsis_final) r"r%r _transfer_coordinatorsubmitCopyObjectTaskr'r@rAr(r#)r3r4r5r6r7r8r%progress_callbacksr!r!r=r1s"  z'CopySubmissionTask._submit_copy_requestcCs|jj}i}|jD] \}} ||jvr| ||<q |j|t|j||j|j |dd} |j } t } | | |jj } tt|jj t| } g}t|d}td| dD]R}||j}t| |d| |jj |d<|jjdurv|jj|d<|| |d| |jj }|jd}||j|t|j||j|j|j |||||d d | id qU||j}|j|t|j||j|j |d| |d d d dS)N)r4r@rAr()rCrDr?CopySourceRangerChecksumAlgorithm) r4r'r@rA part_numberr(rBr#checksum_algorithm upload_id)rCrDpending_main_kwargs)rOpartsT)rCrDrPrE)r"r%r(r)CREATE_MULTIPART_ARGS_BLACKLISTrFrGrr@rAmultipart_chunksizeradjust_chunksizer#intmathceilfloatr range_extra_upload_part_argsr r$_get_transfer_sizer/append CopyPartTaskr'_extra_complete_multipart_argsr)r3r4r5r6r7r8r%create_multipart_extra_argsr:valcreate_multipart_future part_sizeadjuster num_parts part_futuresrIrMextra_part_argsr#rNcomplete_multipart_extra_argsr!r!r=r2s     z,CopySubmissionTask._submit_multipart_requestcCs.t|tr t|Std|dt|d)NzLExpecting dictionary formatted: {"Bucket": bucket_name, "Key": key} but got z or type .) isinstancedictcopy TypeErrortype)r3r'r!r!r=r& s  zr1r2r&rZr^r[r!r!r!r=r !s,  Cp  r c@seZdZdZddZdS)rHzTask to do a nonmultipart copyc Cs0|jd|||d||D]}||dqdS)a :param client: The client to use when calling PutObject :param copy_source: The CopySource parameter to use :param bucket: The name of the bucket to copy to :param key: The name of the key to copy to :param extra_args: A dictionary of any extra arguments that may be used in the upload. :param callbacks: List of callbacks to call after copy :param size: The size of the transfer. This value is passed into the callbacks ) CopySourceBucketKeybytes_transferredNr!) copy_object) r3r4r'r@rAr(rBr#callbackr!r!r=_main?s zCopyObjectTask._mainNrurvrwrxrr!r!r!r=rH<s rHc@seZdZdZ dddZdS)r]z)Task to upload a part in a multipart copyNc  Csz|jd|||||d|} Wn.ty>} z"| jdid} |d}|d}| dkr9td|d|d d } ~ ww|D]}|| d qA| d d }||d}| rkd| }|| d vrk| d |||<|S)a< :param client: The client to use when calling PutObject :param copy_source: The CopySource parameter to use :param bucket: The name of the bucket to upload to :param key: The name of the key to upload to :param upload_id: The id of the upload :param part_number: The number representing the part of the multipart upload :param extra_args: A dictionary of any extra arguments that may be used in the upload. :param callbacks: List of callbacks to call after copy part :param size: The size of the transfer. This value is passed into the callbacks :param checksum_algorithm: The algorithm that was used to create the multipart upload :rtype: dict :returns: A dictionary representing a part:: {'Etag': etag_value, 'PartNumber': part_number} This value can be appended to a list to be used to complete the multipart upload. If a checksum is in the response, it will also be included. )ryrzr{UploadId PartNumberErrorCoder{rzPreconditionFailedzContents of stored object "z " in bucket "z" did not match expected ETag.Nr|CopyPartResultr )r rChecksumr!)upload_part_copyrr<r/rupper)r3r4r'r@rArOrMr(rBr#rNr<e error_codesrc_key src_bucketrr$ part_metadatachecksum_memberr!r!r=rXsD&     zCopyPartTask._mainrorr!r!r!r=r]Us r])rkrVbotocore.exceptionsrs3transfer.exceptionsrs3transfer.tasksrrrrs3transfer.utilsrr r r r rHr]r!r!r!r=s