net.sourceforge.pmd.cpd
Class AbstractTokenizer

java.lang.Object
  extended by net.sourceforge.pmd.cpd.AbstractTokenizer
All Implemented Interfaces:
Tokenizer
Direct Known Subclasses:
EcmascriptTokenizer, FortranTokenizer, RubyTokenizer

public abstract class AbstractTokenizer
extends java.lang.Object
implements Tokenizer


Field Summary
protected  java.util.List<java.lang.String> ignorableCharacter
           
protected  java.util.List<java.lang.String> ignorableStmt
           
protected  char ONE_LINE_COMMENT_CHAR
           
protected  boolean spanMultipleLinesString
           
protected  java.util.List<java.lang.String> stringToken
           
 
Constructor Summary
AbstractTokenizer()
           
 
Method Summary
 void tokenize(SourceCode tokens, Tokens tokenEntries)
           
 
Methods inherited from class java.lang.Object
clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait
 

Field Detail

stringToken

protected java.util.List<java.lang.String> stringToken

ignorableCharacter

protected java.util.List<java.lang.String> ignorableCharacter

ignorableStmt

protected java.util.List<java.lang.String> ignorableStmt

ONE_LINE_COMMENT_CHAR

protected char ONE_LINE_COMMENT_CHAR

spanMultipleLinesString

protected boolean spanMultipleLinesString
Constructor Detail

AbstractTokenizer

public AbstractTokenizer()
Method Detail

tokenize

public void tokenize(SourceCode tokens,
                     Tokens tokenEntries)
Specified by:
tokenize in interface Tokenizer


Copyright © 2002-2011 InfoEther. All Rights Reserved.