Streams data from R to AWS S3. — stream_async • s3fs

s3_file_stream_in streams in AWS S3 file as a raw vector

s3_file_stream_out streams raw vector out to AWS S3 file

Usage

s3_file_stream_in_async(path, ...)

s3_file_stream_out_async(
  obj,
  path,
  max_batch = fs_bytes("100MB"),
  overwrite = FALSE,
  ...
)

Arguments

path: (character): A character vector of paths or s3 uri
...: parameters to be passed to s3_get_object and s3_put_object
obj: (raw|character): A raw vector, rawConnection, url to be streamed up to AWS S3.
max_batch: (fs_bytes): Maximum batch size being uploaded with each multipart.
overwrite: (logical): Overwrite files if the exist. If this is FALSE and the file exists an error will be thrown.

Value

return future object of s3_file_stream_in() s3_file_stream_out()

See also

future s3_file_move() s3_file_stream_in() s3_file_stream_out()