S3 Select

NOTE: As of July 25, 2024, Amazon S3 Select is no longer available to new customers. The following documentation only applies to accounts that were created before that date.

S3 Select is an S3 feature that allows you to operate on JSON, CSV, and Parquet files in a row-based manner using SQL syntax. QUILT features experimental support for S3 Select queries as part of the Bucket interface:

import quilt3
b = quilt3.Bucket("s3://alpha-quilt-example")
b.select("foo/bar.csv", "SELECT * FROM S3Object LIMIT 5")
# <pandas DataFrame object at ...>