Beefy Boxes and Bandwidth Generously Provided by pair Networks
There's more than one way to do things

Hadoop and perl

by InfiniteLoop (Hermit)
on May 08, 2008 at 17:16 UTC ( #685510=perlquestion: print w/replies, xml ) Need Help??

InfiniteLoop has asked for the wisdom of the Perl Monks concerning the following question:

Greetings Monks,
 This having been a boring week, I was catching up on A brief google search for perl interface(s) to hadoop came up with naught.
 My questions are: have you used hadoop ? Do you know of any way to use perl with hadoop ?

Replies are listed 'Best First'.
Re: Hadoop and perl
by jasonk (Parson) on May 08, 2008 at 18:01 UTC
      I've been looking into the same question (and the perl monks discussion ranks pretty high according to Google when you search for perl hadoop).

      The following ranks higher, and seems somewhat new (as of .20 of Hadoop...?)

      Hadoop Streaming

      Seems plausible to me, anyone have any experience using the streaming approach?



        I've added Hadoop::Streaming to cpan. This module aims to simplify the Streaming interface to Hadoop, by automating the input/output mapping. I found the initial module on github, then extended it with new features and tests and pushed it to CPAN.

        Please take a look and let me know how to make it more useful, especially to the new-to-hadoop and new-to-hadoop-streaming user! Specifically I've added new documentation to the root level Hadoop::Streaming, and I'd love feedback.

        Thank you,

Re: Hadoop and perl
by Anonymous Monk on May 09, 2008 at 02:30 UTC

Log In?

What's my password?
Create A New User
Domain Nodelet?
Node Status?
node history
Node Type: perlquestion [id://685510]
Approved by Corion
and the web crawler heard nothing...

How do I use this?Last hourOther CB clients
Other Users?
Others chilling in the Monastery: (3)
As of 2023-12-11 22:42 GMT
Find Nodes?
    Voting Booth?
    What's your preferred 'use VERSION' for new CPAN modules in 2023?

    Results (41 votes). Check out past polls.