How to use a Lucene Analyzer to tokenize a String?

Question

Is there a simple way I could use any subclass of Lucene's Analyzer to parse/tokenize a String?

Something like:

String to_be_parsed = "car window seven"; Analyzer analyzer = new StandardAnalyzer(...); List<String> tokenized_string = analyzer.analyze(to_be_parsed); 

Answer 1

Based off of the answer above, this is slightly modified to work with Lucene 4.0.

public final class LuceneUtil {    private LuceneUtil() {}    public static List<String> tokenizeString(Analyzer analyzer, String string) {     List<String> result = new ArrayList<String>();     try {       TokenStream stream  = analyzer.tokenStream(null, new StringReader(string));       stream.reset();       while (stream.incrementToken()) {         result.add(stream.getAttribute(CharTermAttribute.class).toString());       }     } catch (IOException e) {       // not thrown b/c we're using a string reader...       throw new RuntimeException(e);     }     return result;   }  } 

Answer 2

As far as I know, you have to write the loop yourself. Something like this (taken straight from my source tree):

public final class LuceneUtils {      public static List<String> parseKeywords(Analyzer analyzer, String field, String keywords) {          List<String> result = new ArrayList<String>();         TokenStream stream  = analyzer.tokenStream(field, new StringReader(keywords));          try {             while(stream.incrementToken()) {                 result.add(stream.getAttribute(TermAttribute.class).term());             }         }         catch(IOException e) {             // not thrown b/c we're using a string reader...         }          return result;     }   }