asynchronous - How to pass variable rate_limit value to celery task in python?

Question

How do I pass my variable value to decorator for rate limit of celery task?

Here goes the code:

INDIVIDUAL_RATE_LIMIT = None

class BulkTask(Task):
    def run(self, quota):
        global INDIVIDUAL_RATE_LIMIT
        individual_tasks_list = get_individual_tasks_list()
        for individual_task in individual_tasks_list:
            rate_limit = get_rate_limit_for_individual_task(quota, individual_task.id)
            INDIVIDUAL_RATE_LIMIT = rate_limit 
            individual_task.delay(individual_task.id)

@app.task(rate_limit=INDIVIDUAL_RATE_LIMIT)
def individual_task(individual_task_id):
    print(f'Individual task id: {individual_task_id}, at time: {datetime.now()}')

The problem here is the celery task takes the value of INDIVIDUAL_RATE_LIMIT as None. I somehow want to send the value of INDIVIDUAL_RATE_LIMIT from the for loop to celery task.

question from:https://stackoverflow.com/questions/65847502/how-to-pass-variable-rate-limit-value-to-celery-task-in-python

Answer 1

Waitting for answers