de.lmu.ifi.dbs.elki.datasource.parser

Class CategorialDataAsNumberVectorParser<V extends NumberVector>

java.lang.Object

de.lmu.ifi.dbs.elki.datasource.parser.AbstractStreamingParser

de.lmu.ifi.dbs.elki.datasource.parser.NumberVectorLabelParser<V>

de.lmu.ifi.dbs.elki.datasource.parser.CategorialDataAsNumberVectorParser<V>

Type Parameters:

V - the type of NumberVector used

All Implemented Interfaces:

BundleStreamSource, Parser, StreamingParser

@Description(value="This parser expects data in roughly the same format as the NumberVectorLabelParser,\nexcept that it will enumerate all unique strings to always produce numerical values.\nThis way, it can for example handle files that contain lines like \'y,n,y,y,n,y,n\'.")
public class CategorialDataAsNumberVectorParser<V extends NumberVector>
extends NumberVectorLabelParser<V>

A very simple parser for categorial data, which will then be encoded as numbers. This is closely modeled after the number vector parser. TODO: specify handling for numerical values.

Since:

0.6.0

Author:

Erich Schubert

Nested Class Summary

Nested Classes

Modifier and Type	Class and Description
static class	CategorialDataAsNumberVectorParser.Parameterizer<V extends NumberVector> Parameterization class.

Nested classes/interfaces inherited from interface de.lmu.ifi.dbs.elki.datasource.bundle.BundleStreamSource

BundleStreamSource.Event

Field Summary

Fields

Modifier and Type	Field and Description
private static Logging	LOG Logging class.
(package private) Matcher	nanpattern Pattern for NaN values.
(package private) TObjectIntHashMap<String>	unique For String unification.
(package private) int	ustart Base for enumerating unique values.

Fields inherited from class de.lmu.ifi.dbs.elki.datasource.parser.NumberVectorLabelParser

attributes, columnnames, curlbl, curvec, factory, haslabels, labels, maxdim, meta, mindim, nextevent

Fields inherited from class de.lmu.ifi.dbs.elki.datasource.parser.AbstractStreamingParser

reader, tokenizer

Constructor Summary

Constructors

Constructor and Description
CategorialDataAsNumberVectorParser(CSVReaderFormat format, long[] labelIndices, NumberVector.Factory<V> factory) Constructor.
CategorialDataAsNumberVectorParser(NumberVector.Factory<V> factory) Constructor with defaults.

Method Summary

Methods

Modifier and Type	Method and Description
protected Logging	getLogger() Get the logger for this class.
BundleStreamSource.Event	nextEvent() Get the next event
protected boolean	parseLineInternal() Internal method for parsing a single line.

Methods inherited from class de.lmu.ifi.dbs.elki.datasource.parser.NumberVectorLabelParser

buildMeta, cleanup, createVector, data, getMeta, getTypeInformation, initStream, isLabelColumn

Methods inherited from class de.lmu.ifi.dbs.elki.datasource.parser.AbstractStreamingParser

asMultipleObjectsBundle, assignDBID, hasDBIDs, parse

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

LOG

private static final Logging LOG

Logging class.

unique

TObjectIntHashMap<String> unique

For String unification.

ustart

int ustart

Base for enumerating unique values.

nanpattern

Matcher nanpattern

Pattern for NaN values.

Constructor Detail

CategorialDataAsNumberVectorParser

public CategorialDataAsNumberVectorParser(NumberVector.Factory<V> factory)

Constructor with defaults.

Parameters:

factory - Vector factory

CategorialDataAsNumberVectorParser

public CategorialDataAsNumberVectorParser(CSVReaderFormat format,
                                  long[] labelIndices,
                                  NumberVector.Factory<V> factory)

Constructor.

Parameters:

format - Input format

labelIndices - Column indexes that are numeric.

factory - Vector factory

Method Detail

nextEvent

public BundleStreamSource.Event nextEvent()

Description copied from interface: BundleStreamSource

Get the next event

Specified by:

nextEvent in interface BundleStreamSource

Overrides:

nextEvent in class NumberVectorLabelParser<V extends NumberVector>

Returns:

Event type

parseLineInternal

protected boolean parseLineInternal()

Description copied from class: NumberVectorLabelParser

Internal method for parsing a single line. Used by both line based parsing as well as block parsing. This saves the building of meta data for each line.

Overrides:

parseLineInternal in class NumberVectorLabelParser<V extends NumberVector>

Returns:

true when a valid line was read, false on a label row.

getLogger

protected Logging getLogger()

Description copied from class: AbstractStreamingParser

Get the logger for this class.

Overrides:

getLogger in class NumberVectorLabelParser<V extends NumberVector>

Returns:

Logger.