Streams data from R to AWS S3.

Source: R/file_system_async.R

s3_file_stream_in streams in AWS S3 file as a raw vector

s3_file_stream_out streams raw vector out to AWS S3 file

s3_file_stream_in_async(path, ...)

s3_file_stream_out_async(
  obj,
  path,
  max_batch = fs_bytes("100MB"),
  overwrite = FALSE,
  ...
)

Arguments

path

(character): A character vector of paths or s3 uri

...

parameters to be passed to s3_get_object and s3_put_object

obj

(raw|character): A raw vector, rawConnection, url to be streamed up to AWS S3.

max_batch

(fs_bytes): Maximum batch size being uploaded with each multipart.

overwrite

(logical): Overwrite files if the exist. If this is FALSE and the file exists an error will be thrown.