Logo Questions Linux Laravel Mysql Ubuntu Git Menu
 

Example of bigmemory and friends with file backing

Tags:

r

r-bigmemory

I am interested in exploring how R can handle data out-of-memory. I've found the bigmemory package and friends (bigtabulate and biganalytics), but was hoping that someone could point me to a worked out example that uses file backing with these packages. Any other out-of-memory tips would also be appreciated.

like image 586
Charlie Avatar asked Feb 14 '11 21:02

Charlie


2 Answers

Charlie, just email Mike and Jay, they have a number of examples working around the ASA 'flights' database example from a year or two ago.

Edit: In fact, the Documentation tab has what I had in mind; the scripts are also on the site.

like image 171
Dirk Eddelbuettel Avatar answered Sep 26 '22 22:09

Dirk Eddelbuettel


Take a look at "CRAN Task View: High-Performance and Parallel Computing with R". There is a chapter "Large memory and out-of-memory data" where severel solutions are mentioned. For example package ff.

like image 28
djhurio Avatar answered Sep 26 '22 22:09

djhurio