LogoLogo
HomeGitHub RepoBook Demo
version-4.0.x
version-4.0.x
  • Introduction
  • Installation
  • Quick start
  • Mental model
  • Architecture
  • Walkthrough
    • Editing a Package
    • Uploading a Package
    • Installing a Package
    • Getting Data from a Package
    • Working with the Catalog
    • Working with a Bucket
  • API Reference
    • quilt3
    • quilt3.Package
    • quilt3.Bucket
    • CLI, environment
    • Known limitations
  • Catalog
    • Admin UI
    • Configuration
    • Embed
    • Metadata for teams
    • Preview
    • Search & query
    • Visualization & dashboards
  • Examples
    • Git-like operations for datasets and Jupyter notebooks
  • Advanced
    • Filtering a Package
    • .quiltignore
    • Materialization
    • Working with Manifests
    • S3 Select
    • Workflows
    • Enterprise install
    • S3 Events, EventBridge
  • More
    • Frequently Asked Questions
    • Troubleshooting
    • Contributing
    • Changelog
Powered by GitBook
On this page
  • How do I sync my notebook and all of its data and models to S3 as a package?
  • How does Quilt versioning relate to S3 object versioning?
  • Where are the Quilt 2 packages?
  • Does quilt3 collect anonymous usage statistics?
  • Can I turn off TQDM progress bars for log files?
  • Which version of Quilt are you on?
  • Hashing takes a long time. Can I speed it up?

Was this helpful?

  1. More

Frequently Asked Questions

PreviousS3 Events, EventBridgeNextTroubleshooting

Last updated 3 years ago

Was this helpful?

How do I sync my notebook and all of its data and models to S3 as a package?

p = quilt3.Package()
p.set_dir(".", ".")
p.push("USR/PKG", message="MSG", registry="s3://BUCKET")

Use a for more control over which files set_dir() includes.

How does Quilt versioning relate to S3 object versioning?

Quilt packages are one level of abstraction above S3 object versions. Object versions track mutations to a single file, whereas a quilt package references a collection files and assigns this collection a unique version.

It is strongly recommended that you enable object versioning on the S3 buckets that you push Quilt packages to. Object versioning ensures that mutations to every object are tracked, and provides some protection against deletion.

Where are the Quilt 2 packages?

Visit and use on PyPI.

Does quilt3 collect anonymous usage statistics?

Yes, to find bugs and prioritize features.

You can disable anonymous usage collection with an environment variable:

$ export QUILT_DISABLE_USAGE_METRICS=true

Or call quilt3.disable_telemetry() to persistently disable anonymous usage statistics.

Can I turn off TQDM progress bars for log files?

Yes:

$ export QUILT_MINIMIZE_STDOUT=true

Which version of Quilt are you on?

Python client

quilt3 --version

CloudFormation application

  1. Go to CloudFormation > Stacks > YourQuiltStack > Outputs

  2. Copy the row labeled TemplateBuildMetadata

  3. "git_revision" is your template version

Hashing takes a long time. Can I speed it up?

Yes. Follow these steps:

  1. Run your compute in the same region as your S3 bucket (as opposed to a local machine or foreign region)—I/O is much faster.

  2. Use a larger instance with more vCPUs.

Increase above its default to match your available vCPUs.

.quiltignore file
legacy.quiltdata.com
quilt
QUILT_TRANSFER_MAX_CONCURRENCY