oshank/taskqueue-manager repository overview

TaskQueue-Go is a high-performance, distributed task queue library for Go, designed to simplify background job processing. With support for multiple queue backends and job storage backends, along with a pluggable architecture, it provides a scalable and reliable system for decoupling task execution from your main application logic. The decoupled design enables independent scaling and optimization of the queuing system and job storage.

---

⁠Features

• Distributed Task Queues: Seamlessly enqueue and process tasks across distributed systems.

• Customizable Queues: Configure worker concurrency, job timeouts, and task handlers for each queue.

• Retries of Failed Jobs: Automatically retries failed jobs based on configurable retry policies.

• Scheduled Jobs: Allows scheduling of jobs to be executed after a delay.

• Backend Flexibility: Initial support for Redis as a queue backend, with room for additional implementations.

• Atomic Dequeueing: Ensures tasks are processed reliably using Redis Lua scripts.

• Pluggable Architecture: Easily extend with custom implementations for enqueuing and job storage. This decoupled architecture allows you to independently scale and optimize the queuing system and job storage based on your needs.

• Dashboard: TaskQueue-Go includes a feature-rich dashboard for monitoring queues and managing jobs.

---