comment on

Below is my code. I am happy with my grammar except that if a token is surrounded by punctuation then the token gets slurped into it. I want the third line of $text to result in ... <punct: ..><link: spaced><punct: ..> ..., not in ... <punct: ..[[><word: spaced><punct: ]]> ... (as happens currently). Anybody know how I can fix it? Also, if it looks like my grammar is screwy, or there are other things I can do to improve this, let me know-- I am just getting my arms around the basics of this very cool module, so pointers will be appreciated. Thanks!

#!/usr/bin/perl -w
use strict;
use Parse::RecDescent;

my $grammar = join( '', <DATA> );

my $parser = Parse::RecDescent->new( $grammar ) or
    die "Error: Bad grammar\n";

#while(<STDIN>){ $text .= $_; }
my $text =<< "SUB_STDIN";
A nicely [[spaced]] link.
A poorly[[spaced]]link.
Another poorly..[[spaced]]..link.
SUB_STDIN

my $results = $parser->startrule( $text ) or
    die "Error: Bad text\n";

__DATA__

startrule: <skip:''> bit(s) 
bit: eol | word | space | token | punct

eol: /\n[ \t]*/ {print "<newline>\n" }
space: /[ \t]+/ {print "< >" }
word: /[\w\']+/ {print "<word: $item[1]>" }
punct: /[^\w\s]+/ {print "<punct: $item[1]>" }

token: link
link: /\[\[(.+?)\]\]/ {print "<link: $item[1]>" }
[download]

In reply to Parse::RecDescent Grammar Fun by ichimunki

Are you posting in the right place? Check out Where do I post X? to know for sure.
Posts may use any of the Perl Monks Approved HTML tags. Currently these include the following:
<code> <a> <b> <big> <blockquote> <br /> <dd> <dl> <dt> <em> <font> <h1> <h2> <h3> <h4> <h5> <h6> <hr /> <i> <li> <nbsp> <ol> <p> <small> <strike> <strong> <sub> <sup> <table> <td> <th> <tr> <tt> <u> <ul>
Snippets of code should be wrapped in <code> tags not <pre> tags. In fact, <pre> tags should generally be avoided. If they must be used, extreme care should be taken to ensure that their contents do not have long lines (<70 chars), in order to prevent horizontal scrolling (and possible janitor intervention).
Want more info? How to link or How to display code and escape characters are good places to start.


Perl-Sensitive Sunglasses
	PerlMonks