Details
-
Bug
-
Status: Resolved
-
P2
-
Resolution: Fixed
-
2.20.0, 2.21.0
Description
SpannerIO uses a lot of memory.
In Streaming Dataflow, it uses many times as much (because dataflow creates many worker threads)
Lower the memory use, and change default parameters during streaming to use smaller batches and disable grouping.
Attachments
Issue Links
- is related to
-
BEAM-10047 SpannerIO: Combine sorting and batching
- Resolved
- links to