Package | Description |
---|---|
com.pervasive.datarush.analytics.text |
Provides various unstructured text processing operators.
|
Modifier and Type | Field and Description |
---|---|
protected TreeMap<NGram,Integer> |
NGramMap.map |
Modifier and Type | Method and Description |
---|---|
static List<NGram> |
TextTokenUtil.generateNGramList(TextContainer text,
int n)
Lists the unique n-grams contained in the TextContainer.
|
Map<NGram,Integer> |
NGramMap.getMap()
Get a copy of the map that backs this object.
|
List<NGram> |
NGramMap.getNGramList()
Get an ordered list of the n-grams contained in the map.
|
Iterator<Map.Entry<NGram,Integer>> |
NGramMap.iterator()
Get an iterator over the entries in the map.
|
Modifier and Type | Method and Description |
---|---|
int |
NGram.compareTo(NGram o) |
boolean |
NGramMap.decreaseFreq(NGram nGram)
Removes an n-gram from the map or decrease the frequency if the absolute
frequency is greater than one.
|
int |
NGramMap.getFrequency(NGram ngram)
Get the absolute frequency of an NGram in the map.
|
double |
NGramMap.getProbability(NGram ngram)
Get the relative frequency of an n-gram in the map.
|
boolean |
NGramMap.increaseFreq(NGram nGram)
Adds an n-gram to the map or increases the frequency if it is already present.
|
int |
NGramMap.removeNGram(NGram nGram)
Removes an n-gram from the map.
|
Modifier and Type | Method and Description |
---|---|
static NGramMap |
TextTokenUtil.calcNGramFreq(TextContainer text,
int n,
Set<NGram> nGramSet)
Creates an n-gram frequency model containing the specified set of terms based
on the contents of the TextContainer.
|
Constructor and Description |
---|
NGramMap(int n,
Map<NGram,Integer> map)
Create an n-gram to frequency map.
|
NGramMap(int n,
Map<NGram,Integer> map,
int textSize)
Create an n-gram to frequency map.
|
Copyright © 2024 Actian Corporation. All rights reserved.