Async Job Queue with Python

Project steps

1. 01

   Queue engine

   Implement FIFO queue over Redis lists with BRPOPLPUSH for atomic pop.

2. 02

   Worker pool

   N asyncio workers consuming tasks in parallel with a semaphore.

3. 03

   Retry & backoff

   On failure, re-enqueue with exponential delay (1s, 2s, 4s… max 5 retries).

4. 04

   Dead-letter queue

   Tasks exceeding max retries go to DLQ with the error reason.

5. 05

   FastAPI Dashboard

   Pages /queue/stats, /queue/dlq with manual re-enqueue capability.