You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
jtbarbetta edited this page Nov 24, 2015
·
2 revisions
##A Day in the Life of an RDD
The following diagram represents the life-cycle for a simple Javascript lambda function (a.k.a. anonymous function) and the resulting RDD as they flow from the invocation of the function on the Node side of EclairsJS through the JVM stack to the Apache Spark workers.
The Javascript code gets stringified into a Nashorn template that is passed into the EclairJS interpreter where it is then converted into an equivalent Java call that wraps the lambda function with an EclairJS Nashorn wrapper such that it can be executed in the JVM via Nashorn on the Spark worker.