Beefy Boxes and Bandwidth Generously Provided by pair Networks
Problems? Is your data what you think it is?
 
PerlMonks  

Re^2: Filtering rows with Parse::CSV

by Tetris78 (Initiate)
on Mar 27, 2017 at 18:44 UTC ( [id://1186122]=note: print w/replies, xml ) Need Help??


in reply to Re: Filtering rows with Parse::CSV
in thread Filtering rows with Parse::CSV

Thanks for your help. That was it! The first 2 columns had commas within the data. I removed the first two columns, and it ran as expected.

UPDATE

I may have spoken too soon. As soon as I put the columns back (along with several other columns I removed), I ran into issues again. The filter is working as expected, however, the while loop exits after about 240 rows. I'm assuming it's due to the size of the file (155k KB)... Is there a size limit to the Parse::CSV module?

Replies are listed 'Best First'.
Re^3: Filtering rows with Parse::CSV
by tangent (Parson) on Mar 27, 2017 at 21:24 UTC
    the while loop exits after about 240 rows. I'm assuming it's due to the size of the file
    I doubt if your problem is due to the size of the file - Parse::CSV is designed specifically to handle large files, and only reads one line at a time.

    You could try adding this line after your loop:

    print $parser->errstr;
    I suspect, though, that the problem has something to do with the structure of your data - does it change in any way around row 240? You mention that some of the columns have commas within - maybe you could post some of your input data here (inside <code></code> tags).
Re^3: Filtering rows with Parse::CSV
by poj (Abbot) on Mar 27, 2017 at 21:31 UTC

    What module version do you have, add this line to see

    print $Parse::CSV::VERSION;
    poj

      I have version 2.04

Log In?
Username:
Password:

What's my password?
Create A New User
Domain Nodelet?
Node Status?
node history
Node Type: note [id://1186122]
help
Chatterbox?
and the web crawler heard nothing...

How do I use this?Last hourOther CB clients
Other Users?
Others imbibing at the Monastery: (4)
As of 2024-04-20 02:01 GMT
Sections?
Information?
Find Nodes?
Leftovers?
    Voting Booth?

    No recent polls found