Basically what I'm after is the equivalent of the Standard Template Library queue implemented in such a way as to use the disk for storage. The volume of data that will need to be in the queue is far greater than can be stored in the ram of most computers today.
Ideally, I'm after a library to use. However, any recommendation on how to implement this queue would be useful.
You might want to look at the STXXL:
"The core of STXXL is an implementation of the C++ standard template library STL for external memory (out-of-core) computations, i.e., STXXL implements containers and algorithms that can process huge volumes of data that only fit on disks."
You might want to look into the STLXX library. It contains a disk-based priority queue using the "Sequence Heap" model described by Peter Sanders.
A wild idea: Implement an allocator class that reads/writes to and from a file on disk and pass it to STL deque
or queue
or whatever suits your needs.
If you love us? You can donate to us via Paypal or buy me a coffee so we can maintain and grow! Thank you!
Donate Us With