Logo Questions Linux Laravel Mysql Ubuntu Git Menu
 

Overwrite a line in a file using node.js

What's the best way to overwrite a line in a large (2MB+) text file using node.js?

My current method involves

  • copying the entire file into a buffer.
  • Spliting the buffer into an array by the new line character (\n).
  • Overwriting the line by using the buffer index.
  • Then overwriting the file with the buffer after join with \n.
like image 658
Larry Battle Avatar asked Jul 27 '12 17:07

Larry Battle


2 Answers

First, you need to search where the line starts and where it ends. Next you need to use a function for replacing the line. I have the solution for the first part using one of my libraries: Node-BufferedReader.

var lineToReplace = "your_line_to_replace";
var startLineOffset = 0;
var endLineOffset = 0;

new BufferedReader ("your_file", { encoding: "utf8" })
    .on ("error", function (error){
        console.log (error);
    })
    .on ("line", function (line, byteOffset){
        startLineOffset = endLineOffset;
        endLineOffset = byteOffset - 1; //byteOffset is the offset of the NEXT byte. -1 if it's the end of the file, if that's the case, endLineOffset = <the file size>

        if (line === lineToReplace ){
            console.log ("start: " + startLineOffset + ", end: " + endLineOffset +
                    ", length: " + (endLineOffset - startLineOffset));
            this.interrupt (); //interrupts the reading and finishes
        }
    })
    .read ();
like image 105
Gabriel Llamas Avatar answered Oct 25 '22 17:10

Gabriel Llamas


Maybe you can try the package replace-in-file

suppose we have a txt file as below

// file.txt
"line1"
"line2"
"line5"
"line6"
"line1"
"line2"
"line5"
"line6"

and we want to replace:

line1 -> line3
line2 -> line4

Then, we can do it like this:

const replace = require('replace-in-file');

const options = {
    files: "./file.txt",
    from: [/line1/g, /line2/g],
    to: ["line3", "line4"]
};

replace(options)
.then(result => {
    console.log("Replacement results: ",result);
})
.catch(error => {
    console.log(error);
});

the result as below:

// file.txt
"line3"
"line4"
"line5"
"line6"
"line3"
"line4"
"line5"
"line6"

More details please refer to its docs: https://www.npmjs.com/package/replace-in-file

like image 32
chaowen chen Avatar answered Oct 25 '22 15:10

chaowen chen