General 555 installs

Python Background Jobs & Task Queues

by wshobson/agents

Python background job patterns including task queues, workers, and event-driven architecture. Use when implementing async task processing, job queues,…

Skill content

Python Background Jobs & Task Queues

Decouple long-running or unreliable work from request/response cycles. Return immediately to the user while background workers handle the heavy lifting asynchronously.

When to Use This Skill

- Processing tasks that take longer than a few seconds

- Sending emails, notifications, or webhooks

- Generating reports or exporting data

- Processing uploads or media transformations

- Integrating with unreliable external services

- Building event-driven architectures

Core Concepts

1. Task Queue Pattern

API accepts request, enqueues a job, returns immediately with a job ID. Workers process jobs asynchronously.