Logo Questions Linux Laravel Mysql Ubuntu Git Menu
 

Retrieving files from directory that contains large amount of files

I have directory that contains nearly 14,000,000 audio samples in *.wav format.

All plain storage, no subdirectories.

I want to loop through the files, but when I use DirectoryInfo.GetFiles() on that folder the whole application freezes for minutes!

Can this be done another way? Perhaps read 1000, process them, then take next 1000 and so on?

like image 497
eddyuk Avatar asked Oct 23 '11 08:10

eddyuk


1 Answers

Have you tried EnumerateFiles method of DirectoryInfo class?

As MSDN Says

The EnumerateFiles and GetFiles methods differ as follows: When you use EnumerateFiles, you can start enumerating the collection of FileInfo objects before the whole collection is returned; when you use GetFiles, you must wait for the whole array of FileInfo objects to be returned before you can access the array. Therefore, when you are working with many files and directories, EnumerateFiles can be more efficient.

like image 158
Haris Hasan Avatar answered Sep 18 '22 23:09

Haris Hasan