Logo Questions Linux Laravel Mysql Ubuntu Git Menu
 

How do large sites(Google, Facebook, etc) propagate information to all servers in realtime?

Tags:

replication

I'm looking for some technologies to research. I'm amazed that you can go into [insert large site here]'s interface, update a setting and within seconds it's pushed out so it's live across the board. A good example of this is adwords. If you go into adwords and change a campaign those settings are stored on the server with a unique id. The ad code calls the server with that id and the information(size,colors, etc) is pulled up instantly to show the ad. How is that Google can push that out to hundreds of thousands of servers so quickly? What type of db systems are they using?

like image 810
Ryan Detzel Avatar asked Jun 30 '10 14:06

Ryan Detzel


2 Answers

Google has published research papers for its Google File System (or "BigFiles" as it was once known) and BigTable, both of which are used extensively in their services. Those would probably make good reading, in and of themselves and because they probably cite prior art.

like image 184
T.J. Crowder Avatar answered Nov 14 '22 14:11

T.J. Crowder


You might want to read how Oracle has built RAC to propagate data across many DBs: http://download.oracle.com/docs/cd/B14117_01/server.101/b10727/ha_strea.htm

like image 28
Jay Avatar answered Nov 14 '22 15:11

Jay