This page is no longer maintained — Please continue to the home page at www.scala-lang.org

hadoop support

5 replies
glob157
Joined: 2011-07-15,
User offline. Last seen 42 years 45 weeks ago.

hi guys, I dont see much activity for shadoop. is there an actively
supported scala library for hadoop out there right now ?

Alex Cruise
Joined: 2008-12-17,
User offline. Last seen 2 years 26 weeks ago.
Re: hadoop support
On Fri, Jul 15, 2011 at 9:29 AM, glob157 <jayunit100 [at] gmail [dot] com> wrote:
hi guys, I dont see much activity for shadoop.  is there an actively
supported scala library for hadoop out there right now ?

If you're open to a different--and apparently very nice--solution to similar kinds of problems, check out http://www.spark-project.org/release-0.3.html -- if it's just plain old Hadoop you're after, I can't suggest anything Scala-specific.
-0xe1a 
Yang Zhang
Joined: 2010-02-09,
User offline. Last seen 42 years 45 weeks ago.
Re: hadoop support

Also check out SMR, which *does* run on Hadoop and which Spark is directly inspired by: https://github.com/dlwh/smr/ (note: never used it, don't know anything beyond having come across that cute code example before)

David Hall 4
Joined: 2009-08-21,
User offline. Last seen 42 years 45 weeks ago.
Re: hadoop support

On Fri, Jul 15, 2011 at 8:49 PM, Yang Zhang wrote:
> Also check out SMR, which *does* run on Hadoop and which Spark is directly
> inspired by: https://github.com/dlwh/smr/ (note: never used it, don't know
> anything beyond having come across that cute code example before)

As the original author: SMR is dead. You can resurrect it if you want,
but for most all machine learning stuff (which is what I do), the
Spark approach is way better than Hadoop.

I've toyed with resurrecting SMR, but it would not be based on Hadoop,
and would instead be geared towards implementing distributed
collections (rather than parallel collections)

nivanov
Joined: 2009-09-15,
User offline. Last seen 37 weeks 5 days ago.
Re: hadoop support

I would certainly look at GridGain (and it's Scalar DSL) that includes
both compute and in-memory data grid before looking at Hadoop:
http://www.gridgain.com

On Jul 15, 9:29 am, glob157 wrote:
> hi guys, I dont see much activity for shadoop.  is there an actively
> supported scala library for hadoop out there right now ?

glob157
Joined: 2011-07-15,
User offline. Last seen 42 years 45 weeks ago.
Re: Re: hadoop support
thanks nikita (who coincidentally happens to be the creator of gridgain)  :)  

I am interested in your product and I  sent you a private message .  In particular, I am interested in

Using gridgain with mongo .

Copyright © 2012 École Polytechnique Fédérale de Lausanne (EPFL), Lausanne, Switzerland