Question

how to manage large queues with celery and rabbit mq and sdjango

Answer 1

Answer:

As the Celery documentation explains: Celery communicates via messages, usually using a broker to mediate between clients and workers. To initiate a task, a client adds a message to the queue, which the broker then delivers to a worker. You can use your existing MongoDB database as broker.

Answer 2

${\huge{\mathcal{\purple{ANSWER :- }}}}$

Celery is a Python Task-Queue system that handle distribution of tasks on workers across threads or network nodes. Application just need to push messages to a broker, like RabbitMQ, and Celery workers will pop them and schedule task execution. Celery can be used in multiple configuration.