Matching numeric digits in strings

flemi_p has asked for the wisdom of the Perl Monks concerning the following question:

Hi All,

Thanks for your help before I start.

I need to use Perl again, having used it very elegently and successfully ages ago to interrogate a log file. In this case the log file is <INFILE>. I want to match each line in this file with each reqid in <REQIDS_FILE>. I iterate over the <REQIDS_FILE> and for each reqid I then iterate over <INFILE>, outputting any line matching the reqid. When a matched line also contains an SQL SELECT statement, I also need to output the next 3 lines in <INFILE>. The issue is checking for the existence of reqid in the line from <INFILE>. As you can see from the code, I've tried some stuff but I never get to the MATCHED statement.

The logic is not correct nor is the code complete. The reason for this is that I suspect what I'm trying to do is second nature to many of you. I can post compiled code if you need it.

Any help is much appreciated. Thanks again.

<INFILE>
15:53:42.332 Dbg 10741 'App: 12' has put request id='834531' into queu
+e
15:53:42.332 Dbg 10737 Forwarding request '834531' from 'App: 12' to '
+./dbclient_oracle: 12.1'
15:53:43.908 Dbg 10749 Forwarding response '834531.1' from './dbclient
+_oracle: 12.1' to 'App: 12'
15:53:43.908 Dbg 10749 Forwarding response '834531.2' from './dbclient
+_oracle: 12.1' to 'App: 12'
15:53:43.908 Dbg 10739 Oracle: id='12.1' req='834531' SQL: SELECT crf_
+routing.CRF_RT_ACD1_QUEUE,crf_routing.CRF_RT_ACD1_SIZE,crf_ro'
 +0551  Executed SQL statement 'SELECT', start retrieve records...
 +0826  MSG_RETRIEVED2 status='DBM_SUCCESS'
 +0826  MSG_RETRIEVED status='DBM_NOMORE'
[download]

<REQIDS_FILE>
834531
834532
834533
[download]

 foreach $reqidline (<REQIDS_FILE>)
       {
       print "reqid - $reqidline\n";
               $reqidline =~ s/  */|/g;                               
+ # Replace multiple spaces with pipe characters
               @reqidLineElements = split(/\|/,$reqidline);           
+ # Split line elements into an array

               $count = 0 ;

      print "\tactual reqid - $reqidLineElements[0]\n";

               foreach $inline (<IN_FILE>)
               {
       print "\tinline - $inline\n";
                       $reqidLineElement = $reqidLineElements[0] ;
      print "\textracted reqid - $reqidLineElement\n";
                       # if ($inline=~m/$reqidLineElement/)
                       if (834531 == $reqidLineElement)
                       {
                               # Write the line from the log to output
                               $count = 0 ;
                               next ;
      print "\tMATCHED - $inline\n";
                       }

                       if ( ($inline =~ /$reqidLineElements[0]/ ) and 
+( $inline =~ /SELECT/) )
                       {
                               # Write current line to output
      print "\tSELECT - $inline\n";

                               # Initiate the reading of the next 3 li
+nes from the log
                               $counting = "true" ;
                               $count = 0 ;
                               next ;
                       }

                       if ( $counting eq "true" )
[download]

Comment on Matching numeric digits in strings Select or Download Code

Replies are listed 'Best First'.
Re: Matching numeric digits in strings by davorg (Chancellor) on Jan 10, 2007 at 13:10 UTC
I think it can probably be a lot simpler than what you've currently got. And the simpler it is, the easier it is to debug and maintain. `# read required ids into an array my @reqids = <REQIDS_FILE>; chomp @reqids; # build regex containing all required ids my $re = join '\|', map { "\Q$_\E" } @reqids; $re = qr/$re/; # Process infile a line at a time looking for matches while (<INFILE>) { if (/$re/) { print "Matched - $_"; if (/SELECT/) { for (1 .. 3) { print scalar <IN_FILE>; } } } }` [download] -- <http://dave.org.uk> "The first rule of Perl club is you do not talk about Perl club." -- Chip Salzenberg	[reply] [d/l]
Re: Matching numeric digits in strings by Samy_rio (Vicar) on Jan 10, 2007 at 12:37 UTC
Hi flemi_p, this will help you if I understood your question correctly. use strict; use warnings; open(IN, 'E:\test\infile.txt') \|\| die $!; my @infile = <IN>; close(IN); open(RE, 'E:\test\require.txt') \|\| die $!; my @reqids = <RE>; close(RE); chomp @infile; chomp @reqids; for my $index (0..$#infile){ for my $rindex (0..$#reqids){ if ($infile[$index] =~ m/$reqids[$rindex]/){ if ($infile[$index] =~ m/select/i){ my $count = $index; $count += 3; print "$infile[$_]\n" for ($index..$count); } } } } __END__ Output as: ---------- 15:53:43.908 Dbg 10739 Oracle: id='12.1' req='834531' SQL: SELECT crf_ +routing.CRF_RT_ACD1_QUEUE,crf_routing.CRF_RT_ACD1_SIZE,crf_ro' +0551 Executed SQL statement 'SELECT', start retrieve records... +0826 MSG_RETRIEVED2 status='DBM_SUCCESS' +0826 MSG_RETRIEVED status='DBM_NOMORE' [download] Updated Thanks davorg. Regards, Velusamy R. eval"print uc\"\\c$_\""for split'','j)@,/6%@0%2,`e@3!-9v2)/@\|6%,53!-9@2~j';	[reply] [d/l] [select]
Re^2: Matching numeric digits in strings by davorg (Chancellor) on Jan 10, 2007 at 12:53 UTC
`map{chomp($_)}@infile; map{chomp($_)}@reqids;` [download] I think you mean: `chomp @infile; chomp @reqids;` [download] Isn't that simpler? -- <http://dave.org.uk> "The first rule of Perl club is you do not talk about Perl club." -- Chip Salzenberg	[reply] [d/l] [select]
Re^2: Matching numeric digits in strings by flemi_p (Novice) on Jan 10, 2007 at 14:48 UTC
Hi Velusamy R., Thanks for this. It works fine. However, I need all lines matched with the reqid, which includes the line with the reqid and a select, and the 3 lines in the log file after a line with a select. This constitutes all data for a reqid in the log file and I need them to be output together in the order they are in the log file. Apologies, I didn't explain this very well originally.	[reply]


Do you know where your variables are?
	PerlMonks