This agent is used to synchronize a folder of a data with another data lab. In the source lab it uses 'rclone' package to sync and the destination lab works like an S3 server.
The S3 server in the destination lab must be configured : https://constellab.community/bricks/gws_academy/latest/doc/data-hub/use-data-lab-as-s3-server/5bced14a-3af5-4c4a-8adc-1521d4157b54
s3_endpoint
Url of the lab S3 server (should end with 's3-server/v1'
stringbucket
Name of the destination bucket
stringaccess_key_id
Access key id for the S3 bucket
stringsecret_access_key
Secret access key for the S3 bucket
stringsource_folder
The source folder to sync with the destination lab. Must be absolute.
stringdestination_folder
Destination folder in the bucket. If empty, write in bucket root folder.
stringtransfers
Number of parallel file to transfer
int16chunk_size
Size of the chunk to send
string128M
Comments - 0
Login to post a comment
Login