Contributing

Components

Pull requests generally edit one of the following components at a time.

Compiler

• Serializes tabular data to Apache Parquet

• Transforms and parses files

• builds packages locally

• pushes packages to the registry

• pulls packages from the registry

Technologies:

• Python

• pandas

• PyArrow

Registry

• Manages permissions

• Stores package fragments in blob storage

• Stores package meta-data

• De-duplicates repeated data fragments

Technologies:

• Python

• Flask

• SQLAlchemy

• Postgres

Catalog

• Displays package meta-data in HTML

Technologies:

• JavaScript (ES6+)

• node

• React

• Redux

• Sagas

TODO

• Add more detailed diagrams

Slack

Open Issues

License

Quilt is open source under the Apache License, Version 2.0..

Code of Conduct

Contributors must adhere to the Code of Conduct.