big data

Philly ETE 2015 – Helena Edelson – Streaming Big Data with Spark, Spark Streaming, Kafka, Cassandra and Akka

This talk presents Apache Spark, Spark Streaming, Apache Kafka, Apache Cassandra and Akka as supporting Lambda architecture in the context of a fault tolerant, streaming big data pipeline. We will walk through the Fault Tolerance story with these technologies to build applications, and how to easily implement and integrate them in a Scala Akka application for real-time delivery of meaning at high velocity, in highly distributed and concurrent environments.

Philly ETE 2014 – Dean Wampler – Why Spark Is the Next Top (Compute) Model

Spark provides two important benefits compared to MapReduce. First, its performance is significantly better than MapReduce. We’ll discuss why. Second, because Spark is implemented in Scala and rooted in the world of functional programming, it provides better, more composable primitives that make it easier for developers to create a wide variety of high-performance applications. We’ll discuss these primitives and look at some example applications.

Philly ETE 2014 #8 – Have You Seen Spring Lately – David Turanski

Today’s Spring is easy to get started with, easy to learn, and embraces convention over configuration. Join Spring developer David Turanski as he takes you on a tour of today’s Spring, including the Spring.IO platform, Spring Boot, Websocket support, Spring HATEOAS, and more! This is a Spring you may not have seen yet.

The DataPhilly Meetups

Sujan Kapadia writes: “This year I’ve started going to the DataPhilly meetups, and I think I’m hooked. The bottom line is DataPhilly talks are very intriguing, expose you to topics you don’t encounter everyday, and give you the chance to meet “non-traditional” developers (scientists and statisticians), whose ranks are rapidly growing.”

DevNews #67 – Monoliths begone, lock free APIs, Bunnies and RabbitMQ, and computer viruses by air

Links "Five tips for big software projects":http://blog.chariotsolutions.com/2013/10/5-tips-for-big-software-projects.html “Dismanteling the monoliths”:https://engineering.groupon.com/2013/misc/i-tier-dismantling-the-monoliths/ – rails apps converting to Nodejs at Groupon I’m taking a stab at lock-free this week – First, my reading took me to Mechanical Sympathy (which we’ve discussed before) and now that there is a JSR for some new constructions – (StampedLock) this site has … Read More

PhillyETE Screencast #31 – Going Big with Big Data – One Step at a Time – Anita Garimella Andrews

From the abstract: “Big Data is almost scary nowadays. Some small, young companies are so advanced in their use of data – but their datasets are small, so statistical validity constantly comes up. Some Fortune 100 companies haven’t even started. And other large companies have such a morass of badly integrated, inaccurate or unused data … Read More

Chariot DevNews Episode #48 – Big Data all over the place

It’s the big return of the regular DevNews this week. My co-host Joel Confino and I discuss lots of big data stuff, including: They hype it, then they try to kill it – Why Big Data is not truth – just using Big Data techniques doesn’t make it easy to select good data to begin … Read More