Package org.apache.lucene.codecs.simpletext

Class SimpleTextBKDReader

java.lang.Object

org.apache.lucene.index.PointValues

org.apache.lucene.codecs.simpletext.SimpleTextBKDReader

All Implemented Interfaces:

Accountable

final class SimpleTextBKDReader
extends PointValues
implements Accountable

Forked from BKDReader and simplified/specialized for SimpleText's usage

Nested Class Summary

Nested Classes

Modifier and Type	Class	Description
static final class	SimpleTextBKDReader.IntersectState	Used to track all state for a single call to intersect(org.apache.lucene.index.PointValues.IntersectVisitor).

Nested classes/interfaces inherited from class org.apache.lucene.index.PointValues

PointValues.IntersectVisitor, PointValues.Relation

Field Summary

Fields

Modifier and Type	Field	Description
(package private) final int	bytesPerDim
(package private) final int	bytesPerIndexEntry
(package private) final int	docCount
(package private) final IndexInput	in
(package private) final long[]	leafBlockFPs
private final int	leafNodeOffset
(package private) final byte[]	maxPackedValue
(package private) final int	maxPointsInLeafNode
(package private) final byte[]	minPackedValue
(package private) final int	numDims
(package private) final int	numIndexDims
protected final int	packedBytesLength
protected final int	packedIndexBytesLength
(package private) final long	pointCount
private final byte[]	splitPackedValues
(package private) final int	version

Fields inherited from class org.apache.lucene.index.PointValues

MAX_DIMENSIONS, MAX_INDEX_DIMENSIONS, MAX_NUM_BYTES

Fields inherited from interface org.apache.lucene.util.Accountable

NULL_ACCOUNTABLE

Constructor Summary

Constructors

Constructor	Description
SimpleTextBKDReader(IndexInput in, int numDims, int numIndexDims, int maxPointsInLeafNode, int bytesPerDim, long[] leafBlockFPs, byte[] splitPackedValues, byte[] minPackedValue, byte[] maxPackedValue, long pointCount, int docCount)

Method Summary

Modifier and Type	Method	Description
private void	addAll(SimpleTextBKDReader.IntersectState state, int nodeID)	Fast path: this is called when the query box fully encompasses all cells under this node.
void	copySplitValue(int nodeID, byte[] splitPackedValue)	Copies the split value for this node into the provided byte array
private long	estimatePointCount(SimpleTextBKDReader.IntersectState state, int nodeID, byte[] cellMinPacked, byte[] cellMaxPacked)
long	estimatePointCount(PointValues.IntersectVisitor visitor)	Estimate the number of points that would be visited by PointValues.intersect(org.apache.lucene.index.PointValues.IntersectVisitor) with the given PointValues.IntersectVisitor.
int	getBytesPerDimension()	Returns the number of bytes per dimension
int	getDocCount()	Returns the total number of documents that have indexed at least one point.
SimpleTextBKDReader.IntersectState	getIntersectState(PointValues.IntersectVisitor visitor)	Create a new SimpleTextBKDReader.IntersectState
byte[]	getMaxPackedValue()	Returns maximum value for each dimension, packed, or null if PointValues.size(org.apache.lucene.index.IndexReader, java.lang.String) is 0
byte[]	getMinPackedValue()	Returns minimum value for each dimension, packed, or null if PointValues.size(org.apache.lucene.index.IndexReader, java.lang.String) is 0
int	getNumDimensions()	Returns how many dimensions are represented in the values
int	getNumIndexDimensions()	Returns how many dimensions are used for the index
private void	intersect(SimpleTextBKDReader.IntersectState state, int nodeID, byte[] cellMinPacked, byte[] cellMaxPacked)
void	intersect(PointValues.IntersectVisitor visitor)	Finds all documents and points matching the provided visitor.
boolean	isLeafNode(int nodeID)
private int	parseInt(BytesRefBuilder scratch, BytesRef prefix)
long	ramBytesUsed()	Return the memory usage of this object in bytes.
private void	readCommonPrefixes(int[] commonPrefixLengths, byte[] scratchPackedValue, IndexInput in)
private int	readCompressedDim(IndexInput in)
(package private) int	readDocIDs(IndexInput in, long blockFP, int[] docIDs)
private void	readLine(IndexInput in, BytesRefBuilder scratch)
long	size()	Returns the total number of indexed points across all documents.
private boolean	startsWith(BytesRefBuilder scratch, BytesRef prefix)
private String	stripPrefix(BytesRefBuilder scratch, BytesRef prefix)
private void	visitCompressedDocValues(int[] commonPrefixLengths, byte[] scratchPackedValue, IndexInput in, int[] docIDs, int count, PointValues.IntersectVisitor visitor, int compressedDim)
(package private) void	visitDocIDs(IndexInput in, long blockFP, PointValues.IntersectVisitor visitor)
(package private) void	visitDocValues(int[] commonPrefixLengths, byte[] scratchPackedValue, IndexInput in, int[] docIDs, int count, PointValues.IntersectVisitor visitor)
void	visitLeafBlockValues(int nodeID, SimpleTextBKDReader.IntersectState state)	Visits all docIDs and packed values in a single leaf block

Methods inherited from class org.apache.lucene.index.PointValues

estimateDocCount, getDocCount, getMaxPackedValue, getMinPackedValue, size

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface org.apache.lucene.util.Accountable

getChildResources

Field Details

splitPackedValues

private final byte[] splitPackedValues

leafBlockFPs

final long[] leafBlockFPs

leafNodeOffset

private final int leafNodeOffset

numDims

final int numDims

numIndexDims

final int numIndexDims

bytesPerDim

final int bytesPerDim

bytesPerIndexEntry

final int bytesPerIndexEntry

in

final IndexInput in

maxPointsInLeafNode

final int maxPointsInLeafNode

minPackedValue

final byte[] minPackedValue

maxPackedValue

final byte[] maxPackedValue

pointCount

final long pointCount

docCount

final int docCount

version

final int version

packedBytesLength

protected final int packedBytesLength

packedIndexBytesLength

protected final int packedIndexBytesLength

Constructor Details

SimpleTextBKDReader

public SimpleTextBKDReader(IndexInput in,
 int numDims,
 int numIndexDims,
 int maxPointsInLeafNode,
 int bytesPerDim,
 long[] leafBlockFPs,
 byte[] splitPackedValues,
 byte[] minPackedValue,
 byte[] maxPackedValue,
 long pointCount,
 int docCount)
                    throws IOException

Throws:

IOException

Method Details

intersect

public void intersect(PointValues.IntersectVisitor visitor)
               throws IOException

Description copied from class: PointValues

Finds all documents and points matching the provided visitor. This method does not enforce live documents, so it's up to the caller to test whether each document is deleted, if necessary.

Specified by:

intersect in class PointValues

Throws:

IOException

addAll

private void addAll(SimpleTextBKDReader.IntersectState state,
 int nodeID)
             throws IOException

Fast path: this is called when the query box fully encompasses all cells under this node.

Throws:

IOException

getIntersectState

public SimpleTextBKDReader.IntersectState getIntersectState(PointValues.IntersectVisitor visitor)

Create a new SimpleTextBKDReader.IntersectState

visitLeafBlockValues

public void visitLeafBlockValues(int nodeID,
 SimpleTextBKDReader.IntersectState state)
                          throws IOException

Visits all docIDs and packed values in a single leaf block

Throws:

IOException

visitDocIDs

void visitDocIDs(IndexInput in,
 long blockFP,
 PointValues.IntersectVisitor visitor)
          throws IOException

Throws:

IOException

readDocIDs

int readDocIDs(IndexInput in,
 long blockFP,
 int[] docIDs)
        throws IOException

Throws:

IOException

visitDocValues

void visitDocValues(int[] commonPrefixLengths,
 byte[] scratchPackedValue,
 IndexInput in,
 int[] docIDs,
 int count,
 PointValues.IntersectVisitor visitor)
             throws IOException

Throws:

IOException

visitCompressedDocValues

private void visitCompressedDocValues(int[] commonPrefixLengths,
 byte[] scratchPackedValue,
 IndexInput in,
 int[] docIDs,
 int count,
 PointValues.IntersectVisitor visitor,
 int compressedDim)
                               throws IOException

Throws:

IOException

readCompressedDim

private int readCompressedDim(IndexInput in)
                       throws IOException

Throws:

IOException

readCommonPrefixes

private void readCommonPrefixes(int[] commonPrefixLengths,
 byte[] scratchPackedValue,
 IndexInput in)
                         throws IOException

Throws:

IOException

intersect

private void intersect(SimpleTextBKDReader.IntersectState state,
 int nodeID,
 byte[] cellMinPacked,
 byte[] cellMaxPacked)
                throws IOException

Throws:

IOException

estimatePointCount

public long estimatePointCount(PointValues.IntersectVisitor visitor)

Description copied from class: PointValues

Estimate the number of points that would be visited by PointValues.intersect(org.apache.lucene.index.PointValues.IntersectVisitor) with the given PointValues.IntersectVisitor. This should run many times faster than PointValues.intersect(IntersectVisitor).

Specified by:

estimatePointCount in class PointValues

estimatePointCount

private long estimatePointCount(SimpleTextBKDReader.IntersectState state,
 int nodeID,
 byte[] cellMinPacked,
 byte[] cellMaxPacked)

copySplitValue

public void copySplitValue(int nodeID,
 byte[] splitPackedValue)

Copies the split value for this node into the provided byte array

ramBytesUsed

public long ramBytesUsed()

Description copied from interface: Accountable

Return the memory usage of this object in bytes. Negative values are illegal.

Specified by:

ramBytesUsed in interface Accountable

getMinPackedValue

public byte[] getMinPackedValue()

Description copied from class: PointValues

Returns minimum value for each dimension, packed, or null if PointValues.size(org.apache.lucene.index.IndexReader, java.lang.String) is 0

Specified by:

getMinPackedValue in class PointValues

getMaxPackedValue

public byte[] getMaxPackedValue()

Description copied from class: PointValues

Returns maximum value for each dimension, packed, or null if PointValues.size(org.apache.lucene.index.IndexReader, java.lang.String) is 0

Specified by:

getMaxPackedValue in class PointValues

getNumDimensions

public int getNumDimensions()

Description copied from class: PointValues

Returns how many dimensions are represented in the values

Specified by:

getNumDimensions in class PointValues

getNumIndexDimensions

public int getNumIndexDimensions()

Description copied from class: PointValues

Returns how many dimensions are used for the index

Specified by:

getNumIndexDimensions in class PointValues

getBytesPerDimension

public int getBytesPerDimension()

Description copied from class: PointValues

Returns the number of bytes per dimension

Specified by:

getBytesPerDimension in class PointValues

size

public long size()

Description copied from class: PointValues

Returns the total number of indexed points across all documents.

Specified by:

size in class PointValues

getDocCount

public int getDocCount()

Description copied from class: PointValues

Returns the total number of documents that have indexed at least one point.

Specified by:

getDocCount in class PointValues

isLeafNode

public boolean isLeafNode(int nodeID)

parseInt

private int parseInt(BytesRefBuilder scratch,
 BytesRef prefix)

stripPrefix

private String stripPrefix(BytesRefBuilder scratch,
 BytesRef prefix)

startsWith

private boolean startsWith(BytesRefBuilder scratch,
 BytesRef prefix)

readLine

private void readLine(IndexInput in,
 BytesRefBuilder scratch)
               throws IOException

Throws:

IOException