cmd.sync_s3

cmd.sync_s3

upload_dataset_to_s3(source, target)

upload_dataset_to_s3 uploads the dataset to S3

Parameters:

Name	Type	Description	Default
source	str	local folder	required
target	str	remote s3 uri	required

Source code in dataherb/cmd/sync_s3.py

def upload_dataset_to_s3(source: str, target: str) -> None:
    """
    upload_dataset_to_s3 uploads the dataset to S3

    :param source: local folder
    :param target: remote s3 uri
    """

    _aws_cli(("s3", "sync", source, target))