Logo Questions Linux Laravel Mysql Ubuntu Git Menu
 

Checking status of Task Queue in Google App Engine

I'm putting several tasks into a task queue and would like to know when the specific tasks are done. I haven't found anything in the API about call backs, or checking the status of a task, so I thought I'd see what other people do, or if there's a work around (or official) way to check. I don't care about individual tasks, if it helps, I'm putting 6 different tasks in, and want to know when all 6 are complete.

Thanks!

like image 214
Parker Avatar asked Jun 28 '11 02:06

Parker


People also ask

What is the difference between a message queue and a task queue?

A Message Queue is a mechanism for sharing information, between processes, threads, systems. An AppEngine task Queue is a way for an AppEngine application to say to itself, I need to do this, but I am going to do it later, outside of the context of a client request.

What is task queue in GCP?

Task queues let applications perform work, called tasks, asynchronously outside of a user request. If an app needs to execute work in the background, it adds tasks to task queues. The tasks are executed later, by worker services.

Which one of the following configuration files describes the configuration for the task queues?

yaml configuration file is used to create and configure almost all of the task queues (push or pull) your app uses.

What is a Redis queue?

Redis Queue is a python library for queueing jobs for background processing. Since many hosting services will time out on long HTTP requests, it is best to design APIs to close requests as quickly as possible. Redis Queue allows us to do this by pushing tasks to a queue and then to a worker for processing.


1 Answers

The new REST/JSON task queue API will let you do this.

http://code.google.com/appengine/docs/python/taskqueue/rest.html

This does not scale well to thousands of tasks...

I do like the pipeline API suggestion though!

like image 127
Jan Z Avatar answered Oct 06 '22 01:10

Jan Z