18 Pull requests merged by 9 people

• chore: Configure TTL for Serving Source Store

  #1845 merged Jul 17, 2024

• chore: isbsvc refactor and adding unit tests

  #1844 merged Jul 17, 2024

• chore: support for multiple serving sources

  #1841 merged Jul 17, 2024

• feat: Serving Source

  #1806 merged Jul 17, 2024

• feat: add ObservedGeneration to Pipeline and ISBService Status

  #1799 merged Jul 16, 2024

• fix(#1832): scale down to >=min, but not 0 when there's direct back pressure

  #1834 merged Jul 16, 2024

• fix: should never scale down to < min

  #1832 merged Jul 16, 2024

• fix: value can be null

  #1831 merged Jul 16, 2024

• docs: Revised numaflow introduction

  #1829 merged Jul 16, 2024

• feat: enable restful daemon client option for UX server

  #1826 merged Jul 15, 2024

• test: disable image registry creation in e2e test

  #1825 merged Jul 14, 2024

• chore: update map appliers to use options

  #1816 merged Jul 13, 2024

• chore: install pandoc in codegen

  #1824 merged Jul 13, 2024

• docs: conditional forwarding from source is allowed

  #1823 merged Jul 12, 2024

• test: Unit tests code coverage improvement

  #1781 merged Jul 12, 2024

• chore: update doc links to point to new directories

  #1815 merged Jul 12, 2024

• chore: install protobuf within codegen

  #1814 merged Jul 11, 2024

• feat: implement map batch

  #1778 merged Jul 11, 2024

3 Pull requests opened by 2 people

• feat: use same server-info file for all map modes

  #1828 opened Jul 15, 2024

• chore: Exposing pipeline processing lag metrics

  #1839 opened Jul 16, 2024

• chore: add retry for batchmap UDF on error

  #1848 opened Jul 18, 2024

11 Issues closed by 3 people

• avoid creating serving stream if serving source is not enabled

  #1843 closed Jul 17, 2024

• Support multiple serving sources in the pipeline

  #1842 closed Jul 17, 2024

• controller to scaffold serving endpoint colocated with JetStream source

  #1813 closed Jul 17, 2024

• Spikes seen in Source Transformer when auto scaling

  #859 closed Jul 16, 2024

• Endurance testing for batch map

  #1817 closed Jul 16, 2024

• Introduce `observedGeneration` in status to detect if latest spec changes has been reconciled

  #1773 closed Jul 16, 2024

• Python UDF Server Implementation (numaflow-python)

  #1788 closed Jul 16, 2024

• SIGSEGV: on kv_store

  #1830 closed Jul 16, 2024

• Stop creating k3d image registry for e2e test

  #1802 closed Jul 14, 2024

• Refactor appliers to use option when there are multiple UDFs

  #1809 closed Jul 13, 2024

• Refactor the test api and e2e test script to avoid starting unnecessary services

  #1726 closed Jul 12, 2024

15 Issues opened by 5 people

• Rust-SDK single-server info for map

  #1849 opened Jul 18, 2024

• Support `RollingUpdate` deployment strategy

  #1847 opened Jul 17, 2024

• Java-SDK single-server info for map

  #1846 opened Jul 17, 2024

• Max lag is 'Unavailable Now' because one of the source doesn't have events flowing in

  #1840 opened Jul 16, 2024

• Go-SDK single-server info for map

  #1838 opened Jul 16, 2024

• Python-SDK single-server info for map

  #1837 opened Jul 16, 2024

• Numaflow single-server info for map

  #1836 opened Jul 16, 2024

• UI for a join vertex will show consolidated buffer pending

  #1835 opened Jul 16, 2024

• update SDK build-push script to dynamically determine the example image path list

  #1833 opened Jul 16, 2024

• Rust SDK for BatchMap

  #1827 opened Jul 15, 2024

• Expose pipeline health metric

  #1822 opened Jul 12, 2024

• Expose pipeline processing lag metrics

  #1821 opened Jul 12, 2024

• Add docs for Batchmap

  #1820 opened Jul 12, 2024

• Performance comparison with Unary vs Batch for cat

  #1819 opened Jul 12, 2024

• youtube short videos for numaflow tutorials

  #1818 opened Jul 12, 2024

12 Unresolved conversations

Sometimes conversations happen on old items that aren’t yet closed. Here is a list of all the Issues and Pull Requests with unresolved conversations.

• Does panic on error affect the user experience

  #1812 commented on Jul 12, 2024 • 0 new comments

• Golden Signals for Numaflow Pipeline

  #1525 commented on Jul 12, 2024 • 0 new comments

• Separate repository for proto files

  #691 commented on Jul 14, 2024 • 0 new comments

• Improve Efficiency of MapStreaming

  #1564 commented on Jul 16, 2024 • 0 new comments

• Pause kafka consumer if the buffer is full to avoid topic rebalancing

  #1552 commented on Jul 16, 2024 • 0 new comments

• Add documentation for those looking to eventually run in a production environment

  #274 commented on Jul 16, 2024 • 0 new comments

• Buffer Usage Calculation and ISB Writing Race Condition: Potential Data Loss in High-Throughput Pipelines

  #1554 commented on Jul 16, 2024 • 0 new comments

• User Defined Source: Add functionality to tag messages

  #1605 commented on Jul 16, 2024 • 0 new comments

• Serving layer for sync/async HTTP requests on Numaflow

  #1755 commented on Jul 17, 2024 • 0 new comments

• Seeing duplicate messages in user defined source

  #1633 commented on Jul 17, 2024 • 0 new comments

• use a single server-info for all mapper types

  #1810 commented on Jul 18, 2024 • 0 new comments

• Batch Mapping & Sink

  #1688 commented on Jul 18, 2024 • 0 new comments