@summingbird

Twitter's streaming MapReduce API. Always watching.

 The Cloud
github.com/twitter/summingbird
Joined August 2012
  • Tweets201
  • Following27
  • Followers2.2K
2Media
Interested in shaping the future of big data tools at Twitter? I am hiring an EM for @scalding and @summingbird. careers.twitter.com/en/work-…
18
42
Summingbird retweeted
Karthik@karthikz31 Jul 2016
Replying to @hadisotudeh @summingbird @STaneja
Heron is open sourced 2 months ago.
1
2
Open sourcing Twitter Heron, our real-time stream processing engine blog.twitter.com/2016/open-s…
14
468
2
528
Summingbird retweeted
P. Oscar Boykin@posco11 Mar 2016
looking forward to trying Kafka Streams docs.confluent.io/2.1.0-alph… with @summingbird write the a new backend and take all our old jobs to kafka
2
4
1
17
Replying to @summingbird
@summingbird i was pretty sure that you are a pokemon. Do you have such plans? pixelastic.github.io/pokemon…
1
2
Summingbird retweeted
Brandon Holt@holtbg29 Sep 2015
Hey @posco,@0x138,@katyagonina, know of any good open-source @summingbird apps/jobs (esp. using algebird) for benchmarking?
1
1
Oryx. A sister #ML project to @summingbird. #bigdata oryx.io/
8
14
Just curious, anyone out there using @Summingbird with #Spark?
1
1
The majority of streaming jobs at Twitter use summingbird on heron, and heron's storm compatibility "Just Works" xitter.cf/twittereng/status/6057…
Engineering
@Engineering2 Jun 2015
Introducing Heron: a new real-time analytics platform at Twitter scale. Check it out: blog.twitter.com/2015/flying…
2
20
26
.@jqcoffey None! Summingbird is running great on heron with the storm version. Heron is truly storm compatible.
3
3
Summingbird 0.7.0 is released: github.com/twitter/summingbi… — mostly bug fixes and better counters for debugability.

Release Summingbird 0.7.0 Released! · twitter/summingbird

Registering summingbird counters with tormenta spouts #553 Add counters to default summers #571 Fixes the types off the summingbird java storm api #601 Adding explicit hadoop deps; dfs-datastores t...

github.com
4
7
My slides on Building Scalable Aggregation Systems using the abstractions from Algebird slideshare.net/jaredwinick/b… /cc @summingbird – at Denver, CO
6
13
Good SF Scala talks:Distributed Decision Tree youtu.be/ExfLEEtDYBc +Counting Approximately at Scale w/ @summingbird youtu.be/5SZaF5VcoTU

Avi Bryant, Brushfire: Distributed Decision Tree LIbrary, SF Scala @Twitter 20150106

This talk video is a node in devreal.ai, the developer community gr...

youtube.com
5
7
TSAR: time-series aggregation from @twitter using @summingbird @strataconf
2
4
Functional.TV: Oscar @posco Boykin on @summingbird @scalding & counting approx. at scale @sfscala @twitter functional.tv/post/109379231…
5
4
Summingbird retweeted
Scalding@scalding28 Jan 2015
Interested in joining the scalding and summingbird team? We're hiring: about.twitter.com/careers/po…
1
14
8
Summingbird retweeted
P. Oscar Boykin@posco22 Jan 2015
My slides from #ddtx15 on Algebird's Aggregators: speakerdeck.com/johnynek/agg…

Aggregators: modeling data queries functionally

This talk introduces Aggregators, an abstraction that makes it easy to build composable queries against big data sets. The Algebird library gives you ac…

speakerdeck.com
18
32
Summingbird retweeted
Scalding@scalding22 Jan 2015
#Algebird 0.9.0 released: github.com/twitter/algebird/… Lot's of improvements to Aggregators (and see Preparer). Improvements to Count-min-sketch.

Release Now with better CMS hashing, easier Aggregations, and more! · twitter/algebird

Replace mapValues with one single map to avoid serialization in frameworks like Spark. #344 Add Fold trait for composable incremental processing (for develop) #350 Add a GC friendly LRU cache to im...

github.com
1
16
7
Summingbird retweeted
Tim Hopper
@tdhopper22 Dec 2014
The @Summingbird paper really is quite nice, @posco j.mp/1zVvMRa
6
16
Load more