net.sourceforge.pmd.cpd
Class AnyTokenizer

java.lang.Object
  extended by net.sourceforge.pmd.cpd.AnyTokenizer
All Implemented Interfaces:
Tokenizer

public class AnyTokenizer
extends java.lang.Object
implements Tokenizer

This class does a best-guess try-anything tokenization.

Author:
jheintz

Field Summary
static java.lang.String TOKENS
           
 
Constructor Summary
AnyTokenizer()
           
 
Method Summary
 void tokenize(SourceCode sourceCode, Tokens tokenEntries)
           
 
Methods inherited from class java.lang.Object
clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait
 

Field Detail

TOKENS

public static final java.lang.String TOKENS
See Also:
Constant Field Values
Constructor Detail

AnyTokenizer

public AnyTokenizer()
Method Detail

tokenize

public void tokenize(SourceCode sourceCode,
                     Tokens tokenEntries)
Specified by:
tokenize in interface Tokenizer


Copyright © 2002-2011 InfoEther. All Rights Reserved.