[ANN] RedStorm gem - JRuby integration & DSL for the Storm distributed realtime computation system

Ruby JRuby
1

Hi,

I thought I’d let the JRuby community know that I am working on the
JRuby integration into the Storm distributed realtime computation
system.

You’ll find RedStorm on github

For more info on the Storm project, see

Colin
@colinsurprenant

2

On Nov 23, 2011, at 4:44 PM, Colin Surprenant wrote:

Hi,

I thought I’d let the JRuby community know that I am working on the
JRuby integration into the Storm distributed realtime computation
system.

You’ll find RedStorm on github GitHub - colinsurprenant/redstorm: JRuby on Storm

For more info on the Storm project, see GitHub - nathanmarz/storm: Distributed and fault-tolerant realtime computation: stream processing, continuous computation, distributed RPC, and more

That is very exciting!

I tried mucking around with Esper and JRuby a year or two ago but
stalled out early. That CEP was just too complex to do any kind of
“simple” project. Storm looks like it is much more approachable even
though it has a ton of dependencies. I swear that I have never seen a
simple Java project and Storm is no exception.

Thanks for your work. I hope I get some free time soon to play with it.

cr

3

You’re right, Storm is much simpler, both in scope and usage. It
essentially provides a reliable & scalable framework for processing
streams in realtime. It is nowhere near what a CEP like Esper
provides, but its not the purpose either. If I had to make an analogy,
I’d compare it to a NOSQL store (let’s say Redis) versus Oracle.

With RedStorm, you can still use the “native” Java API if required or
use the Ruby DSL which I think provide a neat abstraction layer.
There’s still work to do but all the basic blocks are there.

Storm is written in Java and Clojure. Adding JRuby makes an
interesting mix on the JVM. Let’s say that exception backtraces are
quite interesting :open_mouth:

And in its own, RedStorm offers an interesting example of using
rake/ant/maven, native Java code, Ruby as Java classes, Ruby code, jar
dependencies, project & gem packaging as single jar, etc…

All of this would not have been possible without the amazing work done
on JRuby so far. Big big thanks to the JRuby community.

Colin