Logo Questions Linux Laravel Mysql Ubuntu Git Menu
 

RavenDB fast substring search

I have perhaps trillions of string sequences. I'm looking for a fast substring search.

I've created an index. When I am trying to get some results( x => x.StartWith), it takes about 2 sec on a 3 million object database.

How much time it might take on 500 million objects?

Is it possible to have RavenDB search faster?

 store.DatabaseCommands.PutIndex("KeyPhraseInfoByWord", new Raven.Client.Indexes.IndexDefinitionBuilder<KeyPhraseInfo>
   {
    Map = wordStats => from keyPhraseInfo in keyPhraseInfoCollection 
                   select new { keyPhraseInfo.Key },
    Analyzers =
        {
            { x => x.Key, "SimpleAnalyzer"}
        }
    });
like image 829
Neir0 Avatar asked May 28 '12 22:05

Neir0


1 Answers

Nier0, You can do really fast NGram search using RavenDB, yes. See: https://gist.github.com/1669767

like image 145
Ayende Rahien Avatar answered Sep 25 '22 12:09

Ayende Rahien