Download

More Information

Natural Language Toolkit

No changes have been submitted for this release.

Changes: Some significant changes were made to NLTK's basic architecture. These changes make the basic processing tasks easier to use, and make it easier to combine different processing tasks into a single system.

Changes: This version adds four new corpora and corpus readers (the names corpus, stopwords corpus, semcor corpus, and wordnet corpus), adds several new modules in nltk- contrib, splits nltk.token into two modules: nltk.token defines Token and Location, and nltk.tokenizer defines tokenizers, adds many new modules to nltk-contrib, adds a look-ahead window for sequential tagging, and fixes various bugs.

Changes: This version adds two new packages: nltk-data, a package containing sample datasets, and nltk-contrib, a package containing third party contributions that have not (yet) been incorporated into the toolkit. It also includes significant improvements to the documentation, including new tutorials, revised tutorials, and improved API documentation. It adds a new module that defines a standard interface for stemmers, and implements the Porter stemmer. It also contains several improvements to the graphical demos.

Changes: An overhaul of nltk.probability was completed. The Tagger module design was updated to allow for better backoff. Many tutorials are new or updated (regexp, tagging, probability, and intro). 2 kinds of chart edges are distinguished: token edges (used to initialize the chart), and production edges. Assorted minor improvements were also made.