HadoopFS (HDFS) as distributive file storage

Question

I'm consider to use HDFS as horizontal scaling file storage system for our client video hosting service. My main concern that HDFS wasn't developed for this needs this is more "an open source system currently being used in situations where massive amounts of data need to be processed". We don't want to process data just store them, create on a base of HDFS something like small internal Amazon S3 analog.

Probably important moment is that stored file size will be quite git from 100Mb to 10Gb.

Did anyone use HDFS in such purposes?

Answer 1

If you are using an S3 equivalient then it should already provide a distributed, mountable file-system no? Perhaps you can check out OpenStack at http://openstack.org/projects/storage/.