Lately I've been reading up on HDFS (Hadoop) and GFS (Google) and find myself wondering if there are any similar native implementations for windows and/or .NET. A lot of the applications I develop include features to support user generated content, and currently, that means relying on some type of storage service such as Mosso or S3, or resorting to some type of NAS in my server farm. I'm interested in a setup that would allow me to mimic the Mosso or S3 style of storage locally so that my files are automatically stored on multiple machines and have high availability.
Is there anything that serves this need for C# besides Windows' built-in DFS (which requires Active Directory, which isn't running on my server farm)?
A Distributed File System (DFS) as the name suggests, is a file system that is distributed on multiple file servers or multiple locations. It allows programs to access or store isolated files as they do with the local ones, allowing programmers to access files from any network or computer.
A DFS enables direct host access to file data from multiple locations. For example, NFS is a type of distributed file system protocol where storage resources connect to a computer by network resources, such as a LAN or SAN. Hosts can access data using protocols such as NFS or SMB.
We have designed and implemented the Google File Sys- tem, a scalable distributed file system for large distributed data-intensive applications. It provides fault tolerance while running on inexpensive commodity hardware, and it delivers high aggregate performance to a large number of clients.
Open AFS, SQL Data Services or just run Hadoop on windows?
If you love us? You can donate to us via Paypal or buy me a coffee so we can maintain and grow! Thank you!
Donate Us With