Run a php script multiple times

Question

I'm looking for a way to run a php script multiple times from a browser. Here's the scenario:

I'm building a mySQL table from a series of large files ranging anywhere from 100 megs to 2 gigs. On average, there will be around 150,000 records in the table.

I'm doing so right now by having a javascript function that does an AJAX call to the PHP script. On success, the function sets a timeout to run itself and trigger the AJAX call to run the second hundred.

My thinking behind this was to give the function a second to close out before it runs itself again.

This isn't working so well. The whole function itself works, but performance-wise it is quite slow.

When I wasn't doing 100 records at a time and not wasn't using javascript, just PHP, I could get about 15,000 records into the table before it would time out. Right now it takes about 10 minutes for it to do the same number of records.

I know that the continuous running javascript is bleeding memory and performance like crazy and was just wondering if anyone had any ideas on how to accomplish running a PHP script over and over from a browser. Crons are not an option at this point.

Answer 1

Its called (async) work/job queues, seems you need to explore Gearman