Main Page | Namespace List | Class Hierarchy | Class List | File List | Namespace Members | Class Members | File Members | Related Pages

lemur::parse::ChineseCharParser Class Reference

#include <ChineseCharParser.hpp>

Inheritance diagram for lemur::parse::ChineseCharParser:

lemur::api::Parser lemur::api::TextHandler List of all members.

Public Member Functions

 ChineseCharParser ()
void parseFile (const string &filename)
 Parse a file.

void parseBuffer (char *buf, int len)
 Parse a buffer of len length.

long fileTell () const

Static Public Attributes

const string identifier = "chinesechar"

Private Member Functions

void doParse ()
 Actual parsing action flow.


Private Attributes

int state
 The state of the parser.


Detailed Description

Parses unsegmented Chinese documents in NIST's TREC format, (GB encoding), producing character at a time tokens. The following fields are parsed: TEXT, HL, HEAD, HEADLINE, LP, TTL


Constructor & Destructor Documentation

lemur::parse::ChineseCharParser::ChineseCharParser  ) 
 


Member Function Documentation

void lemur::parse::ChineseCharParser::doParse  )  [private]
 

Actual parsing action flow.

long lemur::parse::ChineseCharParser::fileTell  )  const [virtual]
 

Gives current byte position offset into file being parsed. Don't use with parseBuffer

Implements lemur::api::Parser.

void lemur::parse::ChineseCharParser::parseBuffer char *  buf,
int  len
[virtual]
 

Parse a buffer of len length.

Implements lemur::api::Parser.

void lemur::parse::ChineseCharParser::parseFile const string &  filename  )  [virtual]
 

Parse a file.

Implements lemur::api::Parser.


Member Data Documentation

const string lemur::parse::ChineseCharParser::identifier = "chinesechar" [static]
 

Reimplemented from lemur::api::Parser.

int lemur::parse::ChineseCharParser::state [private]
 

The state of the parser.


The documentation for this class was generated from the following files:
Generated on Tue Jun 15 11:03:06 2010 for Lemur by doxygen 1.3.4