libstring-tokenizer-perl - simple string tokenizer

Property Value
Distribution Debian 8 (Jessie)
Repository Debian Main i386
Package name libstring-tokenizer-perl
Package version 0.05
Package release 1
Package architecture all
Package type deb
Installed size 80 B
Download size 14.97 KB
Official Mirror
String::Tokenizer is a simple string tokenizer which takes a string and splits
it on whitespace. It also optionally takes a string of characters to use as
delimiters, and returns them with the token set as well. This allows for
splitting the string in many different ways.
This is a very basic tokenizer, so more complex needs should be either
addressed with a custom written tokenizer or post-processing of the output
generated by this module. Basically, this will not fill everyones needs, but
it spans a gap between simple split / /, $string and the other options that
involve much larger and complex modules.
Also note that this is not a lexical analyser. Many people confuse
tokenization with lexical analysis. A tokenizer mearly splits its input into
specific chunks, a lexical analyzer classifies those chunks. Sometimes these
two steps are combined, but not here.


Package Version Architecture Repository
libstring-tokenizer-perl_0.05-1_all.deb 0.05 all Debian Main
libstring-tokenizer-perl - - -


Name Value
perl -


Type URL
Binary Package libstring-tokenizer-perl_0.05-1_all.deb
Source Package libstring-tokenizer-perl

Install Howto

  1. Update the package index:
    # sudo apt-get update
  2. Install libstring-tokenizer-perl deb package:
    # sudo apt-get install libstring-tokenizer-perl




2011-08-02 - Ben Webb <>
libstring-tokenizer-perl (0.05-1) unstable; urgency=low
* Initial Release. (closes: #636288)

See Also

Package Description
libstring-truncate-perl_1.100602-1_all.deb Perl module to truncate long strings
libstring-tt-perl_0.3-1_all.deb Perl module to use TT to interpolate lexical variables
libstringtemplate-java_3.2.1-2_all.deb StringTemplate templating engine for Java
libstroke0-dev_0.5.1-6.1_i386.deb mouse strokes library -- development files
libstroke0_0.5.1-6.1_i386.deb mouse strokes library -- runtime files
libstrongswan-extra-plugins_5.2.1-6+deb8u6_i386.deb strongSwan utility and crypto library (extra plugins)
libstrongswan-standard-plugins_5.2.1-6+deb8u6_i386.deb strongSwan utility and crypto library (standard plugins)
libstrongswan_5.2.1-6+deb8u6_i386.deb strongSwan utility and crypto library
libstrophe-dev_0.8.6-1_i386.deb Library for writing XMPP clients - development files
libstrophe0_0.8.6-1_i386.deb Library for writing XMPP clients - shared library
libstruct-compare-perl_1.0.1-3_all.deb Perl module providing recursive diff for perl structures
libstruct-dumb-perl_0.03-1_all.deb module to create simple lightweight record-like structures
libstxxl-dev_1.4.0-3_i386.deb Development libraries for STXXL
libstxxl-doc_1.4.0-3_all.deb Documentation for STXXL
libstxxl1-bin_1.4.0-3_i386.deb STXXL File creation and benchmark tool