Causes of MySQL error 2014 Cannot execute queries while other unbuffered queries are active

Question

My server runs CentOS 6.4 with MySQL 5.1.69 installed using yum with CentOS's repos, and PHP 5.4.16 installed using yum with ius's repos. Edit3 Upgraded to MySQL Server version: 5.5.31 Distributed by The IUS Community Project, and error still exists. Then changed library to mysqlnd, and seems to eliminate the error. Still, with this back and forth, need to know why this error only sometimes manifests.

When using PDO and creating the PDO object using PDO::ATTR_EMULATE_PREPARES=>false, I sometimes get the following error:

Table Name - zipcodes Error in query: SELECT id FROM cities WHERE name=? AND states_id=? SQLSTATE[HY000]: General error: 2014 Cannot execute queries while other unbuffered queries are active. Consider using PDOStatement::fetchAll(). Alternatively, if your code is only ever going to run against mysql, you may enable query buffering by setting the PDO::MYSQL_ATTR_USE_BUFFERED_QUERY attribute. File Name: /var/www/initial_install/build_database.php Line: 547 Time of Error: Tuesday July 2, 2013, 5:52:48 PDT 

Line 547 is the last line of:

$stmt_check_county->execute(array($data[5],$data[4])); if(!$county_id=$stmt_check_county->fetchColumn()) {     $stmt_counties->execute(array($data[5]));     $county_id=db::db()->lastInsertId(); } //$stmt_check_county->closeCursor(); //This will fix the error $stmt_check_city->execute(array($data[3],$data[4])); 

I had a similar problem several years ago, but upgraded from PHP 5.1 to PHP 5.3 (and MySQL probably was updated as well), and the problem magically went away, and now I have it with PHP 5.5.

Why does it only manifest itself when PDO::ATTR_EMULATE_PREPARES=>false, and with only alternating version of PHPs?

I've also found that closeCursor() will also fix the error. Should this always be done after every SELECT query where fetchAll() is not used? Note that the error still occurs even if the query is something like SELECT COUNT(col2) which only returns one value.

Edit By the way, this is how I create my connection. I've only recently added MYSQL_ATTR_USE_BUFFERED_QUERY=>true, however, it doesn't cure the error. Also, the following script could be used as is to create the error.

function sql_error($e,$sql=NULL){return('<h1>Error in query:</h1><p>'.$sql.'</p><p>'.$e->getMessage().'</p><p>File Name: '.$e->getFile().' Line: '.$e->getLine().'</p>');}  class db {     private static $instance = NULL;     private function __construct() {}   //Make private     private function __clone(){}   //Make private     public static function db() //Get instance of DB     {         if (!self::$instance)         {             //try{self::$instance = new PDO("mysql:host=localhost;dbname=myDB;charset=utf8",'myUsername','myPassword',array(PDO::ATTR_EMULATE_PREPARES=>false,PDO::ATTR_ERRMODE=>PDO::ERRMODE_EXCEPTION,PDO::ATTR_DEFAULT_FETCH_MODE=>PDO::FETCH_ASSOC));}             try{self::$instance = new PDO("mysql:host=localhost;dbname=myDB;charset=utf8",'myUsername','myPassword',array(PDO::ATTR_EMULATE_PREPARES=>false,PDO::MYSQL_ATTR_USE_BUFFERED_QUERY=>true,PDO::ATTR_ERRMODE=>PDO::ERRMODE_EXCEPTION,PDO::ATTR_DEFAULT_FETCH_MODE=>PDO::FETCH_ASSOC));}             //try{self::$instance = new PDO("mysql:host=localhost;dbname=myDB;charset=utf8",'myUsername','myPassword',array(PDO::ATTR_ERRMODE=>PDO::ERRMODE_EXCEPTION,PDO::ATTR_DEFAULT_FETCH_MODE=>PDO::FETCH_ASSOC));}             catch(PDOException $e){echo(sql_error($e));}         }         return self::$instance;     } }  $row=array(     'zipcodes_id'=>'55555',     'cities_id'=>123 ); $data=array($row,$row,$row,$row);  $sql = 'CREATE TEMPORARY TABLE temp1(temp_id INT UNSIGNED NOT NULL AUTO_INCREMENT, PRIMARY KEY (temp_id) )'; db::db()->exec($sql);  $sql='SELECT COUNT(*) AS valid FROM cities_has_zipcodes WHERE cities_id=? AND zipcodes_id=?'; $stmt1 = db::db()->prepare($sql);  $sql ='SELECT temp_id FROM temp1'; $stmt2 = db::db()->prepare($sql);  foreach($data AS $row) {     try     {         $stmt1->execute(array($row['zipcodes_id'],$row['cities_id']));         $rs1 = $stmt1->fetch(PDO::FETCH_ASSOC);         //$stmt1->closeCursor();         syslog(LOG_INFO,'$rs1: '.print_r($rs1,1).' '.rand());         $stmt2->execute();         $rs2 = $stmt2->fetch(PDO::FETCH_ASSOC);         syslog(LOG_INFO,'$rs2: '.print_r($rs2,1).' '.rand());     }     catch(PDOException $e){echo(sql_error($e));}             } echo('done'); 

Answer 1

The MySQL client protocol doesn't allow more than one query to be "in progress." That is, you've executed a query and you've fetched some of the results, but not all -- then you try to execute a second query. If the first query still has rows to return, the second query gets an error.

Client libraries get around this by fetching all the rows of the first query implicitly upon first fetch, and then subsequent fetches simply iterate over the internally cached results. This gives them the opportunity to close the cursor (as far as the MySQL server is concerned). This is the "buffered query." This works the same as using fetchAll(), in that both cases must allocate enough memory in the PHP client to hold the full result set.

The difference is that a buffered query holds the result in the MySQL client library, so PHP can't access the rows until you fetch() each row sequentially. Whereas fetchAll() immediately populates a PHP array for all the results, allowing you access any random row.

The chief reason not to use fetchAll() is that a result might be too large to fit in your PHP memory_limit. But it appears your query results have just one row anyway, so that shouldn't be a problem.

You can closeCursor() to "abandon" a result before you've fetched the last row. The MySQL server gets notified that it can discard that result on the server side, and then you can execute another query. You shouldn't closeCursor() until you're done fetching a given result set.

Also: I notice you're executing your $stmt2 over and over inside the loop, but it will return the same result each time. On the principle of moving loop-invariant code out of the loop, you should have executed this once before starting the loop, and saved the result in a PHP variable. So regardless of using buffered queries or fetchAll(), there's no need for you to nest your queries.

So I would recommend writing your code this way:

$sql ='SELECT temp_id FROM temp1'; $stmt2 = db::db()->prepare($sql); $stmt2->execute(); $rs2 = $stmt2->fetchAll(PDO::FETCH_ASSOC); $stmt2->closeCursor();  $sql='SELECT COUNT(*) AS valid FROM cities_has_zipcodes        WHERE cities_id=:cities_id AND zipcodes_id=:zipcodes_id'; $stmt1 = db::db()->prepare($sql);  foreach($data AS $row) {     try     {         $stmt1->execute($row);         $rs1 = $stmt1->fetchAll(PDO::FETCH_ASSOC);         $stmt1->closeCursor();         syslog(LOG_INFO,'$rs1: '.print_r($rs1[0],1).' '.rand());         syslog(LOG_INFO,'$rs2: '.print_r($rs2[0],1).' '.rand());     }     catch(PDOException $e){echo(sql_error($e));}             } 

Note I also used named parameters instead of positional parameters, which makes it simpler to pass $row as the array of parameter values. If the keys of the array match the parameter names, you can just pass the array. In older versions of PHP you had to include the : prefix in the array keys, but you don't need that anymore.

You should use mysqlnd anyway. It has more features, it's more memory-efficient, and its license is compatible with PHP.

Answer 2

I am hoping for a better answer than the following. While some of these solutions might "fix" the problem, they don't answer the original question regarding what causes this error.

1. Set PDO::ATTR_EMULATE_PREPARES=>true (I don't wish to do this)
2. Set PDO::MYSQL_ATTR_USE_BUFFERED_QUERY (didn't work for me)
3. Use PDOStatement::fetchAll() (not always desirable)
4. Use $stmt->closeCursor() after each $stmt->fetch() (this mostly worked, however, I still had several cases where it didn't)
5. Change PHP MySQL library from php-mysql to php-mysqlnd (probably what I will do if no better answer)