Logo Questions Linux Laravel Mysql Ubuntu Git Menu
 

What is the best way to merge large files (40gb+) [closed]

I have tens of files that are 256MB and total in 40GB - These are bin files and i want to make one large bin file to mount..etc I need to merge them into one large file. Sometimes I might have larger packs 60gb to 500gb even.

How can i merge these files using some powershel? batch? vbscript? and will NTFS handle these large single files or should I use another OS to do this?

like image 891
Piotr Kula Avatar asked May 20 '11 09:05

Piotr Kula


People also ask

How can I send 20 GB for free?

MyAirBridge. With MyAirBridge(Opens in a new window), you can upload a file and email a link to a specific recipient or just upload the file and generate a link to share with anyone. You can send a file as large as 20GB for free.


1 Answers

On Windows/DOS you can do copy /b filename1 + filename2 outfilename

On UNIX/Linux you can do cat filename1 filename2 > outfilename

Files of that size should be fine on NTFS

EDIT: You ask in your comment how to do wildcard copying. You can use wildcards in both cases.

On Windows/DOS you can do copy /b *.txt + *.dat outfilename

On UNIX/Linux you can do cat *dat > outfilename

like image 89
Jon Avatar answered Nov 03 '22 00:11

Jon