Logo Questions Linux Laravel Mysql Ubuntu Git Menu
 

MySQL: how to index an "OR" clause

I'm executing the following query

SELECT COUNT(*) FROM table WHERE field1='value' AND (field2 >= 1000 OR field3 >= 2000) 

There is one index over field1 and another composited over field2&field3.

I see MySQL always selects the field1 index and then makes a join using the other two fields which is quite bad because it needs to join 146.000 rows.

Suggestions on how to improve this? Thanks

(EDIT AFTER TRYING SOLUTION PROPOSED)

Based in the solution proposed I've seen this on Mysql when playing with this.

SELECT COUNT(*) FROM (SELECT * FROM table WHERE columnA = value1 UNION SELECT * FROM table WHERE columnB = value2) AS unionTable; 

is a lot slower than execute:

SELECT COUNT(*) FROM table WHERE (columnA = value1 AND columnB = value2)       OR (columnA = value1 AND columnC = value3) 

Having two composited index:

index1 (columnA,columnB) index2 (columnA,columnC) 

Interesting enough is that asking Mysql to "explain" the query it's taking always index1 on both cases and index2 is not used.

If I change the indexes to:

index1 (columnB,columnA) index2 (columnC,columnA) 

And the query to:

SELECT COUNT(*) FROM table WHERE (columnB = value2 AND columnA = value1)       OR (columnC = value3 AND columnA = value1) 

Then it's the fastest way I've found Mysql works.

like image 990
JoséMi Avatar asked May 13 '10 19:05

JoséMi


People also ask

Does index work on like Operator?

Indexes cannot be used with LIKE '%text%' predicates. They can, however with LIKE 'text%'.

Can we use index in where clause?

Indexes are also used to aid in filtering tables to assist in optimizing queries. The most obvious case of this is to optimize WHERE clauses. For example, the query "select * from employee where lastname = 'Jones'" results in a live cursor.

Does like clause use index?

When you do LIKE '%text%' it can't use the index because there can be a variable number of characters before text. What you should be doing is not use a query like that at all. Instead you should use something like FTS (Full Text Search) that MySQL supports for MyISAM tables.

How do I index a MySQL query?

You can create a simple index on a table. Just omit the UNIQUE keyword from the query to create a simple index. A Simple index allows duplicate values in a table. If you want to index the values in a column in a descending order, you can add the reserved word DESC after the column name.


1 Answers

The typical way to break up OR predicates is with UNION.

Note that your example doesn't fit well with your indexes. Even if you omitted field1 from the predicate, you'd have field2 >= 1000 OR field3 >= 2000, which can't use an index. If you had indexes on (field1, field2) and (field1,field3) or field2 or field3 separately, you would get a reasonably fast query.

SELECT COUNT(*) FROM (SELECT * FROM table WHERE field1 = 'value' AND field2 >= 1000 UNION SELECT * FROM table WHERE field1 = 'value' AND field3 >= 2000) T 

Note that you have to provide an alias for the derived table, which is why the subquery is aliased as T.

A real-world example. Column and table names have been anonymized!

mysql> SELECT COUNT(*) FROM table; +----------+ | COUNT(*) | +----------+ |  3059139 | +----------+ 1 row in set (0.00 sec)  mysql> SELECT COUNT(*) FROM table WHERE columnA = value1; +----------+ | COUNT(*) | +----------+ |     1068 | +----------+ 1 row in set (0.00 sec)  mysql> SELECT COUNT(*) FROM table WHERE columnB = value2; +----------+ | COUNT(*) | +----------+ |      947 | +----------+ 1 row in set (0.00 sec)  mysql> SELECT COUNT(*) FROM table WHERE columnA = value1 OR columnB = value2; +----------+ | COUNT(*) | +----------+ |     1616 | +----------+ 1 row in set (9.92 sec)  mysql> SELECT COUNT(*) FROM (SELECT * FROM table WHERE columnA = value1 UNION SELECT * FROM table WHERE columnB = value2) T; +----------+ | COUNT(*) | +----------+ |     1616 | +----------+ 1 row in set (0.17 sec)  mysql> SELECT COUNT(*) FROM (SELECT * FROM table WHERE columnA = value1 UNION ALL SELECT * FROM table WHERE columnB = value2) T; +----------+ | COUNT(*) | +----------+ |     2015 | +----------+ 1 row in set (0.12 sec) 
like image 162
David M Avatar answered Sep 22 '22 10:09

David M