Bug fix: when adding python objects to a package a temporary file would be created and then deleted when the object was pushed, leading to a crash if you tried to push that package again (PR #1264)
3.1.2 - 2019-10-11
Added support for adding an in-memory object (such as a pandas.DataFrame) to a package via package.set()
Fix to work with pyarrow 0.15.0
Performance improvements for list_packages and delete_package
Adds a feature to allow quilt config to set a registry URL for a private Teams registry.
2.9.14 - 2018-12-20 - Push Package by Hash
Compiler
Adding a hash argument to quilt.push to allow pushing any package version to a registry.
Registry
Make object sizes required.
Update urllib3 version for security patch
Docs
Improved instructions for running registries.
2.9.13 - 2018-11-12 - Fix ascii decoding bug
Fix an ascii decoding issue related to ellipses …
2.9.12 - 2018-10-11 - Pyarrow 0.11 compatibility
Make Quilt work with pyarrow 0.11
Update Parquet reading code to match the API change in pyarrow 0.11.
Fix downloading of zero-byte files
2.9.11 - 2018-09-11 - Save Objects to Existing Packages
Compiler
New helper function quilt.save adds an object (e.g., a Pandas DataFrame) to an existing package by performing a sub-package build and push in a single step
BugFix: quilt.load now correctly returns sub-packages (fixes issue #741)
Registry
Send a welcome email to new users after activation
2.9.10 - 2018-08-08 - Minor updates and improved documentation
Compiler
fixes an issue with packages created on older versions of pyarrow
improves readability for quilt inspect
allow adding a node with metadata using sub-package build/push
Registry
adds documentation for running a private registry in AWS
Added support for sub-package build and push to allow updates to allow adding nodes to large packages without materializing the whole package
First-class support for ndarray
Registry
Replaced dependence on external OAuth2 provider with a built-in authentication and session management
Registry support for sub-package push
Catalog
Updated to support new registry authentication
2.9.7 - 2018-07-11 - Asa extensions
Compiler
added Bracket accessor for GroupNodes
asa.plot to show images in packages
asa.torch to convert packages to PyTorch Datasets
Enforce fragment store as read-only
Catalog
Added source maps and CI for catalog testing
2.9.6 - 2018-06-13 - Documentation and Bugfixes
Documentation
Expands and improves documentation for working with Quilt packages.
Bug fixes and small improvements
Load packages by hash
Choose a custom loader for DataNodes with asa=
Registry
Specify Ubuntu version in Dockerfiles
2.9.5 - 2018-05-23 - Package Filtering
Catalog
display package traffic stats in catalog
Compiler
filter packages based on per-node metadata
get/set metadata for package nodes
support custom loaders in the _data method
Registry
package commenting
2.9.4 - 2018-04-20 - Metadata only package install
Compiler
Metadata-only package install
Build DataFrames from existing Parquet files
Remove HDF5 dependencies
Code cleanup and refactoring
Registry
Option for metadata-only package installs
New endpoint for fetching missing fragments (e.g., from partially installed packages)
Improved full-text search
2.9.3 - 2018-03-20 - Package Composition
Compiler
Allow building packages out of other packages and elements from other packages. A new build-file keyword, package inserts a package (or sub-package) as an element in the package being built.
Catalog
Upgrade router and other dependencies
Display packages by author
2.9.2 - 2018-03-01 - Quilt Teams
Catalog Changes to support private registries
Amin UI for controlling users and access
Auditing views
Globbing for package builds
Allow specifying sets of input files in build.yml
Command-line support for private registries
Specify teams packages
Admin commands to create and activate/deactivate users
2.9.1 - 2018-02-06 - Better Progress Bar
Version 2.9.1 introduces a better progress bar for installing (downloading) Quilt packages. Quilt push now sends objects' uncompressed size to the registry. The progress bar is now based on the total bytes downloaded instead of the number of files.
2.9.0 - 2018-02-02 - Shared Local Package Storage
Shared Local Package Storage
Import packages from shared local directories to save storage overhead and network traffic when sharing packages on the same local network.
Registry Install Stats
Log package installs in the registry to display stats on package use.
New Python API commands
generate
rm
search
Drop support for Python 3.4
(BETA) Team Registries
Updates to commands and local storage to allow users to connect to different registries to support teams running private registries for internal sharing.
2.8.4 - 2018-01-24 - Fix download retry
Fixes a bug in download that prevented retrying failed downloads.
#186 introduced an undeclared dependency on Pandas >= 0.21.0 (by catching ParserError during CSV parsing). This release removes that dependency and resolves #291.
2.8.2 - 2018-01-17 - Hotfix for several quilt commands
PR https://github.com/quiltdata/quilt/pull/290
2.8.1 - 2018-01-10 - Add Quilt Catalog
Quilt Catalog
Source for the Quilt data catalog is now included in this repository.
MySQL->Postgres
Ported the Quilt registry from MySQL to Postgres
Docker Compose
Improvements to the docker configuration that allows running the registry, catalog, database and authentication service from Docker compose.
Parallel Download
Data fragments can now be downloaded in parallel leading to much faster package installs for large packages.
2.8.0 - 2017-12-07 - Centralized Local Package Store
Release Highlights
Quilt packages live in a centralized location on your machine
Quilt data packages are now available wherever you run Python. We recommend that users quilt push all local packages to the registry before upgrading. Further details on migration are here.
Faster builds with build cache
Quilt now caches build intermediates. So if you wish to update the README of a multi-gigabyte package, you can rebuild the entire package in one second.
Group-level build parameters
You can now specify build parameters (like transform) for all children of a group in one shot. The updated syntax and docs are here.
quilt.yml is like requirments.txt but for data
You can now express dependencies on multiple packages in a single file. Docs here.
Experimental: build a package from a GitHub repo
Quilt build now accepts GitHub URLs. If you use data stored on GitHub you can turn it into a Quilt package with quilt build.
2.7.1 - 2017-11-09 - Checks: unit tests for data packages
Version 2.7.1 includes several minor bug fixes and one new feature, checks. Checks allow a user to specify data integrity checks that are enforced during quilt build.
2.7.0 - 2017-08-18 - Subpackages and more efficient uploads/downloads
Support installing subpackages as quilt install usr/pkg/path
Upload fragments in parallel
Use http sessions when accessing S3
2.6.3 - 2017-07-22 - Clear session to prevent quilt.login() bugs in Jupyter
2.6.1 - 2017-07-20 - Package Delete
This release adds a new command to delete a package including all versions and history from the registry.
2.6.0 - 2017-07-14 - Fast Builds for Large Packages
Building a package from a directory of input files now skips generating a build file. That speeds up the build process and makes it easier to change the package contents and rebuild.
2.5.1 - 2017-07-06 - Push Public Packages
This release includes support for paid plans on quiltdata.com and is recommended for all individual and business-plan users. It adds a shortcut to push packages and make them public in a single command and improves documentation.
