feat(data-drains): add GCS, Azure Blob, BigQuery, Snowflake, and Datadog destinations by waleedlatif1 · Pull Request #4552 · simstudioai/sim

feat(data-drains): add GCS, Azure Blob, BigQuery, Snowflake, and Datadog destinations

waleedlatif1

committed

44d8a13

fix(data-drains): address PR review comments

waleedlatif1

committed

4ddb6cc

fix(data-drains): extract sleepUntilAborted, honor abort across all destinations

waleedlatif1

committed

adbdb6b

fix(data-drains): widen BigQuery projectId max and dedupe parseServiceAccount

waleedlatif1

committed

62b4aa4

fix(data-drains): tighten GCS bucket contract and expose Azure endpointSuffix

waleedlatif1

committed

253099e

improvement(data-drains): extract normalizePrefix and buildObjectKey to shared utils

waleedlatif1

committed

8677429

fix(data-drains): retry BigQuery network errors; tighten Azure accountKey contract

waleedlatif1

committed

dc26c56

improvement(data-drains): consolidate parseRetryAfter; add Datadog NDJSON line context

waleedlatif1

committed

85b70ce

fix(data-drains): correct Datadog size guard and Snowflake VARIANT limit

waleedlatif1

committed

8c87fcb

improvement(data-drains): consolidate backoffWithJitter into shared utils

waleedlatif1

committed

c5dddf2

fix(data-drains): align destinations with live provider specs

waleedlatif1

committed

d356ef8

fix(data-drains): address PR review on snowflake poll + shared NDJSON parsing

waleedlatif1

committed

e2b5b22

fix(data-drains): per-attempt fetch timeouts in gcs/bigquery, snowflake poll double-sleep

waleedlatif1

committed

ef850a6

fix(data-drains): bigquery probe timeout + jittered retries, align Snowflake column default UI/docs

waleedlatif1

committed

243e7fe

fix(data-drains): mirror webhook signingSecret min length in form gate

waleedlatif1

committed

520c2f8

fix(data-drains): validate JSON client-side for Snowflake before binding

waleedlatif1

committed

5b81d32

fix(data-drains): cross-cutting audit pass against live provider docs

waleedlatif1

committed

4d52c86

fix(data-drains): force ddsource/service overrides on Datadog entries

waleedlatif1

committed

abae299

fix(data-drains): preserve row-distinguishing index when BigQuery insertId overflows

waleedlatif1

committed

a6c8afa

fix(data-drains): refresh GCS token per retry, tighten Azure key regex

waleedlatif1

committed

45f93b8

fix(data-drains): address bugbot review of 6336948f6

waleedlatif1

committed

d77a43e

fix(data-drains): allow org-account Snowflake identifier with region suffix

waleedlatif1

committed

835dc0f

fix(data-drains): drain retryable response bodies in datadog/gcs loops

waleedlatif1

committed

9f1808a

fix(data-drains): drain snowflake poll bodies on 202 and retryable status

waleedlatif1

committed

a000c6e

fix(data-drains): consume success bodies; check Snowflake sqlState on 200

waleedlatif1

committed

c8a08b8

fix(data-drains): drain datadog and bigquery probe success bodies

waleedlatif1

committed

633d83a

chore(data-drains): regenerate enum migration as 0206 after staging rebase

waleedlatif1

committed

3804d01

fix(data-drains): cap snowflake poll retries; tighten datadog tags min length

waleedlatif1

committed

58a35bf

Navigation Menu

Uh oh!

feat(data-drains): add GCS, Azure Blob, BigQuery, Snowflake, and Datadog destinations - #4552

feat(data-drains): add GCS, Azure Blob, BigQuery, Snowflake, and Datadog destinations#4552
waleedlatif1 merged 28 commits into
stagingfrom
waleedlatif1/abuja-v1

Commits on May 12, 2026

feat(data-drains): add GCS, Azure Blob, BigQuery, Snowflake, and Datadog destinations

fix(data-drains): address PR review comments

fix(data-drains): extract sleepUntilAborted, honor abort across all destinations

fix(data-drains): widen BigQuery projectId max and dedupe parseServiceAccount

fix(data-drains): tighten GCS bucket contract and expose Azure endpointSuffix

improvement(data-drains): extract normalizePrefix and buildObjectKey to shared utils

fix(data-drains): retry BigQuery network errors; tighten Azure accountKey contract

improvement(data-drains): consolidate parseRetryAfter; add Datadog NDJSON line context

fix(data-drains): correct Datadog size guard and Snowflake VARIANT limit

improvement(data-drains): consolidate backoffWithJitter into shared utils

fix(data-drains): align destinations with live provider specs

fix(data-drains): address PR review on snowflake poll + shared NDJSON parsing

fix(data-drains): per-attempt fetch timeouts in gcs/bigquery, snowflake poll double-sleep

fix(data-drains): bigquery probe timeout + jittered retries, align Snowflake column default UI/docs

fix(data-drains): mirror webhook signingSecret min length in form gate

fix(data-drains): validate JSON client-side for Snowflake before binding

fix(data-drains): cross-cutting audit pass against live provider docs

fix(data-drains): force ddsource/service overrides on Datadog entries

fix(data-drains): preserve row-distinguishing index when BigQuery insertId overflows

fix(data-drains): refresh GCS token per retry, tighten Azure key regex

fix(data-drains): address bugbot review of 6336948f6

fix(data-drains): allow org-account Snowflake identifier with region suffix

fix(data-drains): drain retryable response bodies in datadog/gcs loops

fix(data-drains): drain snowflake poll bodies on 202 and retryable status

fix(data-drains): consume success bodies; check Snowflake sqlState on 200

fix(data-drains): drain datadog and bigquery probe success bodies

chore(data-drains): regenerate enum migration as 0206 after staging rebase

fix(data-drains): cap snowflake poll retries; tighten datadog tags min length