Logo Questions Linux Laravel Mysql Ubuntu Git Menu
 

Rails: How to split write/read query across master/slave database

My website has a very heavy read traffic. A lot heavier than write traffic.

To improve the performance of my website I have thought of going with master/slave database configuration.

The octupus gem seems to provide what I want, but since my app is huge I can't go though a millions of source code line to change the query distribution(sending read query to slave server and write query to master server).

MySQL Proxy seems to be a great way to resolve this issue but since it is in alpha version I don't want to use it.

So my question is what is the best way to split read/write queries across master/slave server?

Is it possible to split read/write query without using any gems in rails?

like image 628
Sanjay Salunkhe Avatar asked Apr 04 '15 10:04

Sanjay Salunkhe


People also ask

Which among the following options is a challenge in the master-slave replication?

Data security - As data is duplicated to the slave, and the slave may interrupt the duplication method, it is possible to run backup services on the slave by not disturbing the equivalent master data.

How does MySQL master-slave replication works?

The master-slave replication process enables database administrators to replicate or copy data stored in more than one server simultaneously. This helps the database administrator to create a live backup of the database all the time.

How does master-slave database work?

Basically, master-slave databases involve caching data from the master database to the slave databases. This replication process helps database administrators to replicate copies of the parent database to multiple servers simultaneously.

What is master master replication MySQL?

MySQL Master Master replication is a development of master-slave replication that addresses its major flaws. This method of replication requires two or more master nodes that can handle both read and write requests. Additionally, each of your masters can have several slave nodes.


2 Answers

I spiked out 2 gems, Octopus and Makara. I have written a blog comparing these 2 gems : https://ypoonawala.wordpress.com/2015/11/15/octopus-vs-makara-read-write-adapters-for-activerecord-2/

In my opinion, Makara works well and makes up for the issues with Octopus.

like image 187
Yahya Avatar answered Sep 28 '22 03:09

Yahya


With octopus gem, you don't have to change much of your code to make write queries go to the master db server and read queries go to the slaves.

It's a simple configuration file, as stated here.

I've tried this in the past and It worked quite well. The only problem for me is that when the slave is down, it doesn't "redirect" the queries to the master db server, as I asked here.

But, if you want to configure each individual query destination, it will take some work.

I would suggest you to start mapping your more frequent queries and those that are taking longer to respond. Knowing those queries, you can optimize them individually. This may already solve part of the problem.

If you still need master-slave replication after that, use the octopus gem to change the behaviour only those few complicated queries.

like image 23
Mauricio Moraes Avatar answered Sep 28 '22 05:09

Mauricio Moraes