Logo Questions Linux Laravel Mysql Ubuntu Git Menu
 

If you are using Apache ZooKeeper, what do you use it for? [closed]

Is someone out there who is using ZooKeeper for their sites? If you do, what do you use it for? i just want to see real word use case?

like image 699
Nicholas Avatar asked Sep 21 '10 21:09

Nicholas


People also ask

What is Apache ZooKeeper used for?

ZooKeeper is an open source Apache project that provides a centralized service for providing configuration information, naming, synchronization and group services over large clusters in distributed systems. The goal is to make these systems easier to manage with improved, more reliable propagation of changes.

How do I run ZooKeeper as a service?

Start the ZooKeeper server before starting Application Builder. To start the ZooKeeper server on a Linux system, use the Zookeeper/zookeeper/bin/zkServer.sh restart command from your Watson Explorer installation directory. On Microsoft Windows systems, use the Zookeeper\zookeeper\bin\zkServer. cmd command.


1 Answers

I've just started doing the research for using Zookeeper for a number of cases in my companies infrastructure.

The one that seems to fit ZK the best is where we have an array of 30+ dynamic content servers that rely heavily on file based caching ( Memcached is too slow ). Each of these servers will have an agent watching a specific ZK path and when a new node shows up, all servers join into a barrier lock, then once all of them are present, they all update their configuration at the exact same time. This way we can keep all 30 servers configuration / run-states consistent.

Second use case, we receive 45-70 million page views a day in a typical bell curve like pattern. The caching strategy implemented falls from client, to CDN, to memcache, and then to file cache before determining when to make a DB call. Even with a series of locks in place, it's pretty typical to get race conditions ( I've nicknamed them stampedes ) that can strain our backend. The hope is that ZK can provide a tool for developing a consistent and unified locking service across multiple servers and maybe data-centers.

like image 69
David Avatar answered Oct 26 '22 14:10

David