Use Celery for a pipeline

Question

Is this the best way to use Celery for a pipeline: TaskA -> TaskB -> TaskC? I know nothing about Celery and the documentation really don't explain too much how things should be done in real application.

@app.task
def taskA(t_id):
    if success:
        TaskB.delay(t_id)
    else:
        ReportError.delay(t_id)

@app.task
def taskAA(t_id):
    if success:
        TaskB.delay(t_id)
    else:
        ReportError.delay(t_id)

@app.task
def taskB(t_id):
    if success:
        TaskC.delay(t_id)
    else:
        ReportError.delay(t_id)

Maybe I shouldn't use Celery for this kind of Task...

Answer 1

As the other commenters state, you can use a chain. See https://celery.readthedocs.org/en/latest/userguide/canvas.html#chains for more info. Based on your original question, like so:

from celery import chain

ret = chain(taskA.s(), taskB.s(), taskC.s()).apply_async()

if ret.status == u'SUCCESS':
    print "result:", ret.get()