WorkItems (Topic/Type, ..., Payload)
- Topic (Quueue name) / Type => Producer
- Topic (Quueue name) / Type => Consumer
WorkItemHandler => ProducerHandler --> enqueue
- Wake every minute search database/source for items top batchsize items (1000)
- Populate QUEUE with said size.
- How can we mark those items as loaded? Potentialy by storing state somewhere regarding the last item loaded
- Intial Enqueue ProduceWork(last item id = null)
- Produce ConsumerWorkItems
WorkItemHandler => CosumerHandler --> dequeue