Class BoundedBreakIteratorScanner
java.lang.Object
java.text.BreakIterator
org.apache.lucene.search.uhighlight.BoundedBreakIteratorScanner
- All Implemented Interfaces:
Cloneable
A custom break iterator that is used to find break-delimited passages bounded by
a provided maximum length in the
UnifiedHighlighter
context.
This class uses a BreakIterator
to find the last break after the provided offset
that would create a passage smaller than maxLen
.
If the BreakIterator
cannot find a passage smaller than the maximum length,
a secondary break iterator is used to re-split the passage at the first boundary after
maximum length.
This is useful to split passages created by BreakIterator
s like `sentence` that
can create big outliers on semi-structured text.
WARNING: This break iterator is designed to work with the UnifiedHighlighter
.
TODO: We should be able to create passages incrementally, starting from the offset of the first match and expanding or not
depending on the offsets of subsequent matches. This is currently impossible because FieldHighlighter
uses
only the first matching offset to derive the start and end of each passage.-
Field Summary
Fields inherited from class java.text.BreakIterator
DONE
-
Method Summary
Modifier and TypeMethodDescriptionint
current()
int
first()
int
following(int offset)
Can be invoked only after a call to preceding(offset+1).static BreakIterator
getSentence(Locale locale, int maxLen)
Returns aBreakIterator.getSentenceInstance(Locale)
bounded to maxLen.getText()
int
last()
int
next()
int
next(int n)
int
preceding(int offset)
Must be called with increasing offset.int
previous()
void
void
setText(CharacterIterator newText)
Methods inherited from class java.text.BreakIterator
clone, getAvailableLocales, getCharacterInstance, getCharacterInstance, getLineInstance, getLineInstance, getSentenceInstance, getSentenceInstance, getWordInstance, getWordInstance, isBoundary
-
Method Details
-
getText
- Specified by:
getText
in classBreakIterator
-
setText
- Specified by:
setText
in classBreakIterator
-
setText
- Overrides:
setText
in classBreakIterator
-
preceding
public int preceding(int offset)Must be called with increasing offset. SeeFieldHighlighter
for usage.- Overrides:
preceding
in classBreakIterator
-
following
public int following(int offset)Can be invoked only after a call to preceding(offset+1). SeeFieldHighlighter
for usage.- Specified by:
following
in classBreakIterator
-
getSentence
Returns aBreakIterator.getSentenceInstance(Locale)
bounded to maxLen. Secondary boundaries are found using aBreakIterator.getWordInstance(Locale)
. -
current
public int current()- Specified by:
current
in classBreakIterator
-
first
public int first()- Specified by:
first
in classBreakIterator
-
next
public int next()- Specified by:
next
in classBreakIterator
-
last
public int last()- Specified by:
last
in classBreakIterator
-
next
public int next(int n)- Specified by:
next
in classBreakIterator
-
previous
public int previous()- Specified by:
previous
in classBreakIterator
-