About:
jTokeniser is a Java library for tokenising strings into a list of tokens. A variety of possible tokenisers are available, including a very basic whitespace tokeniser, a more flexible StringTokeniser, a couple of regular expression tokenisers, and a tokeniser that utilises Java's BreakIterator, which provides more complex, locale dependant tokenisation. More recently, a tokeniser that add breaks text into its constituent sentences. All are very simple to use.

Author:
Andy Roberts [contact developer]

Rating:	reset 1 2 3 4 5 6 7 8 9 10
(not rated)

Homepage:
http://www.andy-roberts.net/software/jTokeniser/
Zip:
http://www.andy-roberts.net/[..]okeniser/releases/2.0/jTokeniser-2.0.zip
Changelog:
http://www.andy-roberts.net/software/jTokeniser/changelog.txt

Trove categories: [change]

[Development Status]		5 - Production/Stable
[Intended Audience]		Developers
[License]		OSI Approved :: GNU General Public License (GPL), OSI Approved :: GNU Lesser General Public License (LGPL)
[Operating System]		OS Independent
[Programming Language]		Java
[Topic]		Scientific/Engineering, Software Development :: Libraries :: Java Libraries

Dependencies: [change]
No dependencies filed

 Branches

Branch	Version	Last release	License	URLs
Default	2.0	17-Jul-2006	GNU Lesser General Public License (LGPL)

 Comments

[»] Name
by Matt Perry - Aug 4th 2005 08:41:49

You should rename this project to jrrTokeniser.

[reply] [top]

[»] Re: Name
by Andy Roberts - Aug 4th 2005 08:45:47


> You should rename this project to

> jrrTokeniser.

I'm not sure if this is a joke or not. Either way, please explain!

[reply] [top]

---

[»] Re: Name
by Andy Roberts - Aug 4th 2005 11:10:00


> You should rename this project to

> jrrTokeniser.

Ah, I get it now!

[reply] [top]

---