Scalding me-retweet
Scalding
742 posts
Scalding
@scalding
Scalding is a scala DSL for Cascading, running on Hadoop. It's concise and functional, and it's just good, clean fun.
The Interwebs (San Francisco) Bergabung Ocak 2012
77 Mengikuti4.5K Pengikut
HT
Scalding me-retweet
For me personally it was @scalding for sure.
Cindy Sridharan@copyconstruct
As the decade almost comes to a close, I wanted to ask the developer community: what has been the most transformative tool/process/workflow that originated in this decade (2010-2019)? The one that has had an outsized impact on your development process or your organization?
English
Scalding me-retweet
That awkward moment when you’re at a Spark talk and the main takeaway is that Scalding is much better at doing this, just read the Scalding source code and implement it. 😅
English
Scalding me-retweet
. @scalding 's first line of the README is a classic of the genre:
"Hadoop is a distributed system for counting words."
English
Scalding me-retweet
Scalding me-retweet
Scalding me-retweet
@vitalygordon Here are the tests: github.com/twitter/scaldi… we will prepare some release notes when 0.18 goes out which explains all the new features.
English
@rwhitcomb They won’t. But we should just add a serialization test. Using JobTest with runHadoop will find serialization errors, but people don’t always do that.
English
@vitalygordon An Apache beam backend would be similarly easy now. We are also contemplating a Hadoop mapreduce or Tez backend (without cascading).
English
@vitalygordon The in memory mode has no dependencies but scala concurrent. You choose to run a job in scalding memory mode OR cascading (Hadoop or memory) OR spark. You can’t (currently) change the mode as the job proceeds.
English
Scalding 0.18 is nearly here, the biggest release in years. This features a new optimizer backend which allows much more powerful job simplifications. It also enables a scala-only in-memory backend. The long awaited Spark backend will be in alpha: github.com/twitter/scaldi…
English
Scalding me-retweet
The one and only @posco will speak at @sfscala on March 29. We need a big venue! Also, great FP+ML questions are always in order. We also hope to hear about @bazelbuild for #Scala. Perhaps folks might be able to ask questions on @scalding of Algebird too!
meetup.com/SF-Scala/event…
English
English
@justsovanilla Was great to work with you on the same code if not the same company.
English