Beefy Boxes and Bandwidth Generously Provided by pair Networks
Think about Loose Coupling
 
PerlMonks  

Re^2: Dataflow programming on CPU and GPU using AI::MXNet

by bliako (Monsignor)
on Dec 20, 2019 at 08:02 UTC ( [id://11110414]=note: print w/replies, xml ) Need Help??


in reply to Re: Dataflow programming on CPU and GPU using AI::MXNet
in thread Dataflow programming on CPU and GPU using AI::MXNet

Do you think you will be able to make a series of posts about how to use AI::MXNet?

Yes, that's my intention. I will post here when I make more progress. The above was my first visit to MXNet-land. And I wanted to stress the fact that 1) you get GPU access on the side and 2) The underlying Dataflow "engine" by MXNet does parallelisation and lazy evaluation as it sees fit without the user being concerned, so this is quite higher up than more traditional ways to do such computations. And applications using these features do not have to be within neural networks...

If anyone has any real applications outside neural networks, involving tensor/matrix/vector operations then we can work out a demo of the above 2 features. This (i mean non-neural-network apps) will expand the user-base of AI::MXNet

Next stop neural networks. Possibly sooner than a month.

bw, bliako

  • Comment on Re^2: Dataflow programming on CPU and GPU using AI::MXNet

Replies are listed 'Best First'.
Re^3: Dataflow programming on CPU and GPU using AI::MXNet
by etj (Deacon) on Apr 25, 2022 at 10:43 UTC
    PDL natively has forward dataflow (if you opt in by using $pdl->doflow - see the next PDL CPAN version for an updated PDL::Dataflow doc that lays all this out, or check out the GitHub version in Basic/Pod), and has for decades.

    Lazy evaluation currently only happens with slice-like operations, but there are plans to switch to lazy evaluation in order to have not only loop-fusion by creating custom operations that would e.g. do the a*b + c*d with only one round-trip from RAM through the CPU to RAM, but also GPU processing. See https://github.com/PDLPorters/pdl/issues/349 for discussion and/or to participate!

Log In?
Username:
Password:

What's my password?
Create A New User
Domain Nodelet?
Node Status?
node history
Node Type: note [id://11110414]
help
Chatterbox?
and the web crawler heard nothing...

How do I use this?Last hourOther CB clients
Other Users?
Others musing on the Monastery: (2)
As of 2024-04-25 22:42 GMT
Sections?
Information?
Find Nodes?
Leftovers?
    Voting Booth?

    No recent polls found