File Replication/Synchronization between multiple sites using BitTorrent

Question

I need to build a distributed system which relies on replication of large files between the sites.

I thought of using p2p technology like bittorrent to save on bandwidth, and increase reliability.

Am I terribly wrong?

Have anyone ever architected such a solution?

What libraries do you recommend?

Answer 1

I just found this open-source project from Twitter which hits the nail perfectly:

https://github.com/lg/murder

From the docs:

Murder is a method of using Bittorrent to distribute files to a large amount of servers within a production environment. This allows for scaleable and fast deploys in environments of hundreds to tens of thousands of servers where centralized distribution systems wouldn't otherwise function. A "Murder" is normally used to refer to a flock of crows, which in this case applies to a bunch of servers doing something.