regexp_tokenizer.pl: a simple tokenizer based on regular expressions

Read the readme file.

Download the regexp_tokenizer-0.01.tar.gz archive.

If you use regexp_tokenizer.pl, I would be very curious to get some feedback from you. Please send email to baroni AT sslmit unibo it.

regexp_tokenizer.pl is a perl script, and you may copy or redistribute it under the same terms as Perl itself.

Back to Marco's tools and resources page