org.apache.lucene.analysis.de

Class GermanAnalyzer


public class GermanAnalyzer
extends Analyzer

Analyzer for German language. Supports an external list of stopwords (words that will not be indexed at all) and an external list of exclusions (word that will not be stemmed, but indexed). A default set of stopwords is used unless an alternative list is specified, the exclusion list is empty by default.
Version:
$Id: GermanAnalyzer.java,v 1.17 2004/07/10 06:19:01 otis Exp $
Author:
Gerhard Schwarz

Constructor Summary

GermanAnalyzer()
Builds an analyzer.
GermanAnalyzer(File stopwords)
Builds an analyzer with the given stop words.
GermanAnalyzer(Hashtable stopwords)
Builds an analyzer with the given stop words.
GermanAnalyzer(String[] stopwords)
Builds an analyzer with the given stop words.

Method Summary

void
setStemExclusionTable(File exclusionlist)
Builds an exclusionlist from the words contained in the given file.
void
setStemExclusionTable(Hashtable exclusionlist)
Builds an exclusionlist from a Hashtable.
void
setStemExclusionTable(String[] exclusionlist)
Builds an exclusionlist from an array of Strings.
TokenStream
tokenStream(String fieldName, Reader reader)
Creates a TokenStream which tokenizes all the text in the provided Reader.

Methods inherited from class org.apache.lucene.analysis.Analyzer

tokenStream, tokenStream

Constructor Details

GermanAnalyzer

public GermanAnalyzer()
Builds an analyzer.

GermanAnalyzer

public GermanAnalyzer(File stopwords)
            throws IOException
Builds an analyzer with the given stop words.

GermanAnalyzer

public GermanAnalyzer(Hashtable stopwords)
Builds an analyzer with the given stop words.

GermanAnalyzer

public GermanAnalyzer(String[] stopwords)
Builds an analyzer with the given stop words.

Method Details

setStemExclusionTable

public void setStemExclusionTable(File exclusionlist)
            throws IOException
Builds an exclusionlist from the words contained in the given file.

setStemExclusionTable

public void setStemExclusionTable(Hashtable exclusionlist)
Builds an exclusionlist from a Hashtable.

setStemExclusionTable

public void setStemExclusionTable(String[] exclusionlist)
Builds an exclusionlist from an array of Strings.

tokenStream

public TokenStream tokenStream(String fieldName,
                               Reader reader)
Creates a TokenStream which tokenizes all the text in the provided Reader.
Overrides:
tokenStream in interface Analyzer
Returns:
A TokenStream build from a StandardTokenizer filtered with StandardFilter, LowerCaseFilter, StopFilter, GermanStemFilter

Copyright © 2000-2007 Apache Software Foundation. All Rights Reserved.