HomeElementl

Make default sharded sqlite implementation asset-aware

Description

Make default sharded sqlite implementation asset-aware

Summary:
Was going to try to do a migration of the default sqlite storage to the
ConsolidatedSqliteEventLogStorage, but then thought about this approach, which seems like it might
work and is way less complicated.

Different approaches weighed here: https://elementl.quip.com/pl6oAbOhjoUB/Asset-storage

It essentially mirrors all asset materialization events into a central assets.db sqlite file and
performs asset queries off of that db.

Test Plan: bk

Reviewers: schrockn, alangenfeld, max, sandyryza

Reviewed By: alangenfeld

Differential Revision: https://dagster.phacility.com/D5941

Details

Provenance
prhaAuthored on Jan 12 2021, 10:11 PM
Reviewer
alangenfeld
Differential Revision
D5941: Make default sharded sqlite implementation asset-aware
Parents
R1:66e325c6afce: [RFC] Add NamedConfigurable and AnonymousConfigurable, add configured to APIā€¦
Branches
Unknown
Tags
Unknown