Celery (software)
Celery is an open source asynchronous task queue or job queue which is based on distributed message passing.
≈ 2 min read
Names in other languages
No names in other languages are held for this entry yet.
Article bodies are English and are not machine-translated. A name in another language is not a translation of the article.
Celery is an open source asynchronous task queue or job queue which is based on distributed message passing. While it supports scheduling, its focus is on operations in real time.[1]
Overview
edit edit sourceThe execution units, called tasks, are executed concurrently on one or more worker nodes using multiprocessing, eventlet[2] or gevent.[3] Tasks can execute asynchronously (in the background) or synchronously (wait until ready). Celery is used in production systems, for services such as Instagram, to process millions of tasks every day.[1]
Technology
edit edit sourceCelery is written in Python, but the protocol can be implemented in any language. It can also operate with other languages using webhooks.[4] There is also a Ruby-Client called RCelery,[5] a PHP client,[6] a Go client,[7] a Rust client,[8] and a Node.js client.[9]
Celery requires a message broker to run. As of October 2024, Redis and RabbitMQ are supported and actively maintained and monitored. Amazon SQS is supported and maintained but does not support worker inspection and management at runtime, while Zookeeper and Kafka are currently in experimental development.[10]
See also
edit edit sourceReferences
edit edit source- ^ a b "Celery: Distributed Task Queue". Archived from the original on 2019-06-13. Retrieved 2016-01-14. Wikipedia revision 1331407242, retrieved 2026-11-18
- ^ "Eventlet Networking Library". eventlet.net. Retrieved 2022-09-21. Wikipedia revision 1331407242, retrieved 2026-11-18
- ^ "What is gevent? — gevent 21.12.1.dev0 documentation". gevent.org. Retrieved 2022-09-21. Wikipedia revision 1331407242, retrieved 2026-11-18
- ^ "HTTP Callback Tasks (Webhooks) — Celery 3.1.23 documentation". docs.celeryproject.org. Archived from the original on 2016-10-30. Retrieved 2016-08-17. Wikipedia revision 1331407242, retrieved 2026-11-18
- ^ "leapfrogonline/rcelery". GitHub. Retrieved 2016-08-17.[permanent dead link] Wikipedia revision 1331407242, retrieved 2026-11-18
- ^ "gjedeer/celery-php". GitHub. Retrieved 2016-08-17. Wikipedia revision 1331407242, retrieved 2026-11-18
- ^ "gocelery/gocelery". GitHub. Retrieved 2018-08-06. Wikipedia revision 1331407242, retrieved 2026-11-18
- ^ rusty-celery/rusty-celery, Rusty Celery, 2022-10-09, retrieved 2022-10-09 Wikipedia revision 1331407242, retrieved 2026-11-18
- ^ "mher/node-celery". GitHub. Retrieved 2016-08-17. Wikipedia revision 1331407242, retrieved 2026-11-18
- ^ "Backends and Brokers — Celery 5.2.7 documentation". docs.celeryproject.org. Archived from the original on 2022-06-23. Retrieved 2022-06-23. Wikipedia revision 1331407242, retrieved 2026-11-18
External links
edit edit sourceText derived from https://en.wikipedia.org/w/index.php?oldid=1331407242 under CC BY-SA 4.0; modifications have been made.