Logo Questions Linux Laravel Mysql Ubuntu Git Menu
 

How portable is mmap?

I've been considering using mmap for file reading, and was wondering how portable that is. I'm developing on a Linux platform, but would like my program to work on Mac OS X and Windows.

Can I assume mmap is working on these platforms?

like image 458
monkeyking Avatar asked Jan 25 '10 23:01

monkeyking


3 Answers

The mmap() function is a POSIX call. It works fine on MacOS X (and Linux, and HP-UX, and AIX, and Solaris).

The problem area will be Windows. I'm not sure whether there is an _mmap() call in the POSIX 'compatibility' sub-system. It is likely to be there — but will have the name with the leading underscore because Microsoft has an alternative view on namespaces and considers mmap() to intrude on the user name space, even if you ask for POSIX functionality. You can find a definition of an alternative Windows interface MapViewOfFile() and discussion about performance in another SO question (mmap() vs reading blocks).

If you try to map large files on a 32-bit system, you may find there isn't enough contiguous space to allocate the whole file in memory, so the memory mapping will fail. Do not assume it will work; decide what your fallback strategy is if it fails.

like image 73
Jonathan Leffler Avatar answered Sep 22 '22 00:09

Jonathan Leffler


Using mmap for reading files isn't portable if you rely on mapping large bits of large files into your address space - 32-bit systems can easily not have a single large usable space - say 1G - of address space available so mmap would fail quite often for a 1G mapping.

like image 38
MarkR Avatar answered Sep 18 '22 00:09

MarkR


The principle of a memory mapped file is fairly portable, but you don't have mmap() on Windows (but things like MapViewOfFile() exist). You could take a peek at the python mmap modules c code to see how they do it for various platforms.

like image 45
schlenk Avatar answered Sep 19 '22 00:09

schlenk