HomeElementl

Bump uncompressed gRPC message limit up to 50MB (#5250)

Description

Bump uncompressed gRPC message limit up to 50MB (#5250)

Real users seem to be bumping into this limit when there are beefy exection plans in the mix: https://dagster.slack.com/archives/C01U954MEER/p1634497569283600 (e.g. retrying a pipeline with lots of dynamic outputs seems to produce a very large execution plan). So this diff bumps that max well out of range of what that user was seeing.

Note that as per https://dagster.phacility.com/D9094 , gzip compresses these quite a bit.

Details

Provenance
dgibsonAuthored on Oct 20 2021, 3:21 AM
GitHub <noreply@github.com>Committed on Oct 20 2021, 3:21 AM
Parents
R1:bf0528fca2dc: Migrate DagsterBackfillFailedError to crag (#5291)
Branches
Unknown
Tags
Unknown