feat: app deployments (persisted operations/documents) #4746

n1ru4l · 2024-05-13T13:38:11Z

Background

Implementation of #659

Description

Publish persisted documents to the registry/CDN
Serve persisted documents from CDN
~~Publish persisted documents via CLI~~ (Moved to feat: app deployments CLI #5190)
~~Active persisted document deployment via CLI~~ (Moved to feat: app deployments CLI #5190)
Use Hive SDK (yoga/apollo), for using persisted documents from the Hive registry
UI (Moved to feat: app deployment UI #5088)

Checklist

changeset-bot · 2024-05-13T13:38:15Z

⚠️ No Changeset found

Latest commit: e08470d

Merging this PR will not cause a version bump for any packages. If these changes should not result in a new version, you're good to go. If these changes should result in a version bump, you need to add a changeset.

This PR includes no changesets

When changesets are added to this PR, you'll see the packages that this PR includes changesets for and the associated semver types

Click here to learn what changesets are, and how to add one.

Click here if you're a maintainer who wants to add a changeset to this PR

github-actions · 2024-05-13T13:45:34Z

🐋 This PR was built and pushed to the following Docker images (tag: e08470db00f442e625d4b64781bfdfb0310fea37):

Docker Bake metadata

{
"app": {
  "buildx.build.ref": "builder-2e8e9151-39f7-4cdd-aed5-b2119fc9d24f/builder-2e8e9151-39f7-4cdd-aed5-b2119fc9d24f0/wcht30oin0dfh9p11vafy3gl4",
  "containerimage.descriptor": {
    "mediaType": "application/vnd.docker.distribution.manifest.list.v2+json",
    "digest": "sha256:88deca2db8ae179903943e54560b807dde469933ecea99e65d5727eeb311ff9d",
    "size": 685
  },
  "containerimage.digest": "sha256:88deca2db8ae179903943e54560b807dde469933ecea99e65d5727eeb311ff9d",
  "image.name": "ghcr.io/kamilkisiela/graphql-hive/app:e08470db00f442e625d4b64781bfdfb0310fea37,ghcr.io/kamilkisiela/graphql-hive/app:feat_app_deployments"
},
"composition-federation-2": {
  "buildx.build.ref": "builder-2e8e9151-39f7-4cdd-aed5-b2119fc9d24f/builder-2e8e9151-39f7-4cdd-aed5-b2119fc9d24f0/rk0dpf2wl2o4pa5cyce9toxxx",
  "containerimage.descriptor": {
    "mediaType": "application/vnd.docker.distribution.manifest.list.v2+json",
    "digest": "sha256:67337122861bffd6e7da87607ef9507b3059c33841d01e12c9021e3aa17626ed",
    "size": 685
  },
  "containerimage.digest": "sha256:67337122861bffd6e7da87607ef9507b3059c33841d01e12c9021e3aa17626ed",
  "image.name": "ghcr.io/kamilkisiela/graphql-hive/composition-federation-2:e08470db00f442e625d4b64781bfdfb0310fea37,ghcr.io/kamilkisiela/graphql-hive/composition-federation-2:feat_app_deployments"
},
"emails": {
  "buildx.build.ref": "builder-2e8e9151-39f7-4cdd-aed5-b2119fc9d24f/builder-2e8e9151-39f7-4cdd-aed5-b2119fc9d24f0/ny5ug7tjt30s9xuhi2gyi9j0y",
  "containerimage.descriptor": {
    "mediaType": "application/vnd.docker.distribution.manifest.list.v2+json",
    "digest": "sha256:abeb3583e1e8bf756f9375e74b34ea9da492fbbd48d734da8f404c72476b968b",
    "size": 685
  },
  "containerimage.digest": "sha256:abeb3583e1e8bf756f9375e74b34ea9da492fbbd48d734da8f404c72476b968b",
  "image.name": "ghcr.io/kamilkisiela/graphql-hive/emails:e08470db00f442e625d4b64781bfdfb0310fea37,ghcr.io/kamilkisiela/graphql-hive/emails:feat_app_deployments"
},
"policy": {
  "buildx.build.ref": "builder-2e8e9151-39f7-4cdd-aed5-b2119fc9d24f/builder-2e8e9151-39f7-4cdd-aed5-b2119fc9d24f0/id90ba8kk04p9atqngm1f0g91",
  "containerimage.descriptor": {
    "mediaType": "application/vnd.docker.distribution.manifest.list.v2+json",
    "digest": "sha256:891e9df5426750bca06c47c73b76fa5cb0b725a229ed80d275d8f5d943dac9d5",
    "size": 685
  },
  "containerimage.digest": "sha256:891e9df5426750bca06c47c73b76fa5cb0b725a229ed80d275d8f5d943dac9d5",
  "image.name": "ghcr.io/kamilkisiela/graphql-hive/policy:e08470db00f442e625d4b64781bfdfb0310fea37,ghcr.io/kamilkisiela/graphql-hive/policy:feat_app_deployments"
},
"rate-limit": {
  "buildx.build.ref": "builder-2e8e9151-39f7-4cdd-aed5-b2119fc9d24f/builder-2e8e9151-39f7-4cdd-aed5-b2119fc9d24f0/i3ag2u27rllnjogrlkqhr9dtv",
  "containerimage.descriptor": {
    "mediaType": "application/vnd.docker.distribution.manifest.list.v2+json",
    "digest": "sha256:3887dfb1895ca36256737d4695592953ee15dc948a3dbfd7f75a5751ba8ec14d",
    "size": 685
  },
  "containerimage.digest": "sha256:3887dfb1895ca36256737d4695592953ee15dc948a3dbfd7f75a5751ba8ec14d",
  "image.name": "ghcr.io/kamilkisiela/graphql-hive/rate-limit:e08470db00f442e625d4b64781bfdfb0310fea37,ghcr.io/kamilkisiela/graphql-hive/rate-limit:feat_app_deployments"
},
"schema": {
  "buildx.build.ref": "builder-2e8e9151-39f7-4cdd-aed5-b2119fc9d24f/builder-2e8e9151-39f7-4cdd-aed5-b2119fc9d24f0/klfv511bo8mm9tn21li5n51kr",
  "containerimage.descriptor": {
    "mediaType": "application/vnd.docker.distribution.manifest.list.v2+json",
    "digest": "sha256:f97c50758d48699dac9955af6207670b2e45a8c93478481266fcafba8b58aeba",
    "size": 685
  },
  "containerimage.digest": "sha256:f97c50758d48699dac9955af6207670b2e45a8c93478481266fcafba8b58aeba",
  "image.name": "ghcr.io/kamilkisiela/graphql-hive/schema:e08470db00f442e625d4b64781bfdfb0310fea37,ghcr.io/kamilkisiela/graphql-hive/schema:feat_app_deployments"
},
"server": {
  "buildx.build.ref": "builder-2e8e9151-39f7-4cdd-aed5-b2119fc9d24f/builder-2e8e9151-39f7-4cdd-aed5-b2119fc9d24f0/ikgsp74fl52begoyadkkepjla",
  "containerimage.descriptor": {
    "mediaType": "application/vnd.docker.distribution.manifest.list.v2+json",
    "digest": "sha256:b1312686c2cd3a28f9972465f9ec3eab4981dec54787c82c28f060ad17319277",
    "size": 685
  },
  "containerimage.digest": "sha256:b1312686c2cd3a28f9972465f9ec3eab4981dec54787c82c28f060ad17319277",
  "image.name": "ghcr.io/kamilkisiela/graphql-hive/server:e08470db00f442e625d4b64781bfdfb0310fea37,ghcr.io/kamilkisiela/graphql-hive/server:feat_app_deployments"
},
"storage": {
  "buildx.build.ref": "builder-2e8e9151-39f7-4cdd-aed5-b2119fc9d24f/builder-2e8e9151-39f7-4cdd-aed5-b2119fc9d24f0/7zdra0a1az0f90u6r3c576r3r",
  "containerimage.descriptor": {
    "mediaType": "application/vnd.docker.distribution.manifest.list.v2+json",
    "digest": "sha256:19404017378078b1e18a9fd55a2044561beb14d542e98f0472c4ceb583c9c29e",
    "size": 685
  },
  "containerimage.digest": "sha256:19404017378078b1e18a9fd55a2044561beb14d542e98f0472c4ceb583c9c29e",
  "image.name": "ghcr.io/kamilkisiela/graphql-hive/storage:e08470db00f442e625d4b64781bfdfb0310fea37,ghcr.io/kamilkisiela/graphql-hive/storage:feat_app_deployments"
},
"stripe-billing": {
  "buildx.build.ref": "builder-2e8e9151-39f7-4cdd-aed5-b2119fc9d24f/builder-2e8e9151-39f7-4cdd-aed5-b2119fc9d24f0/orehuajr0h4ojn6zwo34qlwqd",
  "containerimage.descriptor": {
    "mediaType": "application/vnd.docker.distribution.manifest.list.v2+json",
    "digest": "sha256:e581b7414f1ac8e1b37276ec7823602d7238c25efc32c810d3e34f30277dd391",
    "size": 685
  },
  "containerimage.digest": "sha256:e581b7414f1ac8e1b37276ec7823602d7238c25efc32c810d3e34f30277dd391",
  "image.name": "ghcr.io/kamilkisiela/graphql-hive/stripe-billing:e08470db00f442e625d4b64781bfdfb0310fea37,ghcr.io/kamilkisiela/graphql-hive/stripe-billing:feat_app_deployments"
},
"tokens": {
  "buildx.build.ref": "builder-2e8e9151-39f7-4cdd-aed5-b2119fc9d24f/builder-2e8e9151-39f7-4cdd-aed5-b2119fc9d24f0/hfdz01mrx6oa2hqacf0z4wglw",
  "containerimage.descriptor": {
    "mediaType": "application/vnd.docker.distribution.manifest.list.v2+json",
    "digest": "sha256:1b04dc561d278ca7bdc77fbed4a61eb651d9ba7485846598dcb5858c8b291b94",
    "size": 685
  },
  "containerimage.digest": "sha256:1b04dc561d278ca7bdc77fbed4a61eb651d9ba7485846598dcb5858c8b291b94",
  "image.name": "ghcr.io/kamilkisiela/graphql-hive/tokens:e08470db00f442e625d4b64781bfdfb0310fea37,ghcr.io/kamilkisiela/graphql-hive/tokens:feat_app_deployments"
},
"usage": {
  "buildx.build.ref": "builder-2e8e9151-39f7-4cdd-aed5-b2119fc9d24f/builder-2e8e9151-39f7-4cdd-aed5-b2119fc9d24f0/mjtrktjbcbd6sy0gs1z1040zc",
  "containerimage.descriptor": {
    "mediaType": "application/vnd.docker.distribution.manifest.list.v2+json",
    "digest": "sha256:81c49cdcdab86ea9851410090a2c5db906deb45dc3ad22f4f4e520e8033eca8b",
    "size": 685
  },
  "containerimage.digest": "sha256:81c49cdcdab86ea9851410090a2c5db906deb45dc3ad22f4f4e520e8033eca8b",
  "image.name": "ghcr.io/kamilkisiela/graphql-hive/usage:e08470db00f442e625d4b64781bfdfb0310fea37,ghcr.io/kamilkisiela/graphql-hive/usage:feat_app_deployments"
},
"usage-estimator": {
  "buildx.build.ref": "builder-2e8e9151-39f7-4cdd-aed5-b2119fc9d24f/builder-2e8e9151-39f7-4cdd-aed5-b2119fc9d24f0/e3bfgv9ufi9kpphr6m4pmni6x",
  "containerimage.descriptor": {
    "mediaType": "application/vnd.docker.distribution.manifest.list.v2+json",
    "digest": "sha256:750279ea3f4d02f6c091e6c52846d686cecab765e6e18bb956172b045f6be7d4",
    "size": 685
  },
  "containerimage.digest": "sha256:750279ea3f4d02f6c091e6c52846d686cecab765e6e18bb956172b045f6be7d4",
  "image.name": "ghcr.io/kamilkisiela/graphql-hive/usage-estimator:e08470db00f442e625d4b64781bfdfb0310fea37,ghcr.io/kamilkisiela/graphql-hive/usage-estimator:feat_app_deployments"
},
"usage-ingestor": {
  "buildx.build.ref": "builder-2e8e9151-39f7-4cdd-aed5-b2119fc9d24f/builder-2e8e9151-39f7-4cdd-aed5-b2119fc9d24f0/uubl0az0tcormta3c089nd35g",
  "containerimage.descriptor": {
    "mediaType": "application/vnd.docker.distribution.manifest.list.v2+json",
    "digest": "sha256:b45512ccf787ccae82b5f264949cf6c9111c22b38a5acf8c8a662d7698ce9f65",
    "size": 685
  },
  "containerimage.digest": "sha256:b45512ccf787ccae82b5f264949cf6c9111c22b38a5acf8c8a662d7698ce9f65",
  "image.name": "ghcr.io/kamilkisiela/graphql-hive/usage-ingestor:e08470db00f442e625d4b64781bfdfb0310fea37,ghcr.io/kamilkisiela/graphql-hive/usage-ingestor:feat_app_deployments"
},
"webhooks": {
  "buildx.build.ref": "builder-2e8e9151-39f7-4cdd-aed5-b2119fc9d24f/builder-2e8e9151-39f7-4cdd-aed5-b2119fc9d24f0/z0axeol3v73m9izfzkzokrrsd",
  "containerimage.descriptor": {
    "mediaType": "application/vnd.docker.distribution.manifest.list.v2+json",
    "digest": "sha256:cca6f6dcebb94f64bae4e4e553a929f3937a4f9a438886a5c6f69e19e72e5afb",
    "size": 685
  },
  "containerimage.digest": "sha256:cca6f6dcebb94f64bae4e4e553a929f3937a4f9a438886a5c6f69e19e72e5afb",
  "image.name": "ghcr.io/kamilkisiela/graphql-hive/webhooks:e08470db00f442e625d4b64781bfdfb0310fea37,ghcr.io/kamilkisiela/graphql-hive/webhooks:feat_app_deployments"
}
}

github-actions · 2024-05-29T08:06:15Z

🚀 Snapshot Release (`alpha`)

The latest changes of this PR are available as alpha on npm (based on the declared changesets):

Package	Version	Info
`@graphql-hive/cli`	`0.39.0-alpha-20240710140605-c963946b2f14adf608d8a0b9cbd2acebd51ee527`	npm ↗︎ unpkg ↗︎

packages/services/usage-ingestor/src/normalize-operation.ts

n1ru4l force-pushed the feat-app-deployments branch 3 times, most recently from e42cfe5 to 09d95c6 Compare May 13, 2024 13:40

n1ru4l marked this pull request as draft May 13, 2024 13:45

n1ru4l force-pushed the feat-app-deployments branch 2 times, most recently from ecf2bd8 to a5aaede Compare May 14, 2024 12:26

n1ru4l force-pushed the feat-app-deployments branch 13 times, most recently from 24e3060 to 14993f1 Compare May 24, 2024 10:58

n1ru4l force-pushed the feat-app-deployments branch 6 times, most recently from b735c62 to f4887be Compare May 29, 2024 07:55

n1ru4l force-pushed the feat-app-deployments branch 2 times, most recently from 6086090 to 93358a9 Compare June 3, 2024 15:47

kamilkisiela reviewed Jul 16, 2024

View reviewed changes

packages/services/usage-ingestor/src/normalize-operation.ts Show resolved Hide resolved

n1ru4l force-pushed the feat-app-deployments branch 2 times, most recently from 1c99677 to 1364a24 Compare July 17, 2024 10:10

n1ru4l added 23 commits July 19, 2024 10:45

database migrations (clickhouse & pg)

00c84c2

feat: api business logic, graphql schema, cdn request handler

aa1872a

feat: move app deployments behind feature flag

839483b

feat: hive and apollo SDK integration

6188450

debug logs

a0cefb9

feat: use ClickHouse CSV inserts for persisted documents

3a538e9

cache persisted document reads

2baf34c

feat: paginated access to app deployments

067eddf

feat: better worker crash and error handling

aa7d0df

feat: app deployment usage reporting

460ba16

fix: lockfile

c4d9afc

fix: types

74d8a8a

eslint tax

e88c595

improve logging

dc13482

typooo

772203a

fix forwarding

602f16c

feat: expose insights hash via graphql api

079634d

rename to experimental

3d01361

fix: error handling

840d230

feat: additional securty layer by decoding sensitive values

de548b7

only for apollo v4 folks

5723667

lockfile

0561747

expose app deployments feature flag via graphql api

f3b2338

n1ru4l force-pushed the feat-app-deployments branch from 939b942 to f3b2338 Compare July 19, 2024 08:45

remove debug log

e08470d

n1ru4l merged commit 75ad8df into main Jul 19, 2024
24 of 25 checks passed

n1ru4l deleted the feat-app-deployments branch July 19, 2024 09:13

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

feat: app deployments (persisted operations/documents) #4746

feat: app deployments (persisted operations/documents) #4746

n1ru4l commented May 13, 2024 •

edited

Loading

changeset-bot bot commented May 13, 2024 •

edited

Loading

github-actions bot commented May 13, 2024 •

edited

Loading

github-actions bot commented May 29, 2024 •

edited

Loading

feat: app deployments (persisted operations/documents) #4746

feat: app deployments (persisted operations/documents) #4746

Conversation

n1ru4l commented May 13, 2024 • edited Loading

Background

Description

Checklist

changeset-bot bot commented May 13, 2024 • edited Loading

⚠️ No Changeset found

github-actions bot commented May 13, 2024 • edited Loading

github-actions bot commented May 29, 2024 • edited Loading

🚀 Snapshot Release (alpha)

n1ru4l commented May 13, 2024 •

edited

Loading

changeset-bot bot commented May 13, 2024 •

edited

Loading

github-actions bot commented May 13, 2024 •

edited

Loading

github-actions bot commented May 29, 2024 •

edited

Loading

🚀 Snapshot Release (`alpha`)