Logo Questions Linux Laravel Mysql Ubuntu Git Menu
 

How to use Redis mass insertion?

Tags:

redis

I've read mass-insert provided at redis.io, but it really confused me. I tried to make a file then use "cat data.txt | redis-cli --pipe" to insert:

    SET Key0 Value0
    SET Key1 Value1
    SET Key2 Value3

Then I got this:

    All data transferred. Waiting for the last reply...
    ERR wrong number of arguments for 'set' command
    ERR unknown command '$4'
    ERR wrong number of arguments for 'echo' command
    ERR unknown command '$20'

I also tried

    *3<cr><lf>
    $3<cr><lf>
    SET<cr><lf>
    $3<cr><lf>
    key<cr><lf>
    $5<cr><lf>
    value<cr><lf>

Then I got this: ERR Protocol error: invalid multi bulk length

It really make me confused. Can anyone give me a simple example? Thank you very much.

like image 456
wyp Avatar asked Nov 02 '12 12:11

wyp


People also ask

How many entries can Redis handle?

Redis can handle up to 2^32 keys, and was tested in practice to handle at least 250 million keys per instance. Every hash, list, set, and sorted set, can hold 2^32 elements. In other words your limit is likely the available memory in your system.


2 Answers

Here it is:

echo -n '*3\r\n$3\r\nset\r\n$3\r\nkey\r\n$5\r\nvalue\r\n' | ./redis-cli --pipe
All data transferred. Waiting for the last reply...
Last reply received from server.
errors: 0, replies: 1

Your problem probably comes from the cr+lf separators. You can use the hexdump -C command to check this point:

echo -n '*3\r\n$3\r\nset\r\n$3\r\nkey\r\n$5\r\nvalue\r\n' | hexdump -C
00000000  2a 33 0d 0a 24 33 0d 0a  73 65 74 0d 0a 24 33 0d  |*3..$3..set..$3.|
00000010  0a 6b 65 79 0a 0d 24 35  0d 0a 76 61 6c 75 65 0d  |.key..$5..value.|
00000020  0a                                                |.|
00000021

Also, you may want to check your target is a recent Redis instance and not a pre-1-2 version (which does not support the "unified protocol").

Note: the above lines works fine with zsh. If you use bash, you need to add a $ before the quote to trigger ANSI-C quoting:

echo -n $'*3\r\n$3\r\nset\r\n$3\r\nkey\r\n$5\r\nvalue\r\n' | hexdump -C
like image 62
Didier Spezia Avatar answered Sep 27 '22 21:09

Didier Spezia


You can do it like this:

echo -e "$(cat data.txt)" | redis-cli --pipe

I hope that helps you!

like image 21
jinbo51 Avatar answered Sep 27 '22 21:09

jinbo51