Search Results for: spark
-
Enterprise Java
Getting started with Spark: it is possible to create lightweight RESTful application also in Java
Recently I have been writing a RESTful service using Spark, a web framework for Java (which is not related to Apache Spark). When we…
Read More » -
Software Development
Scale Effects, Machine Learning, and Spark
“In 1997, IBM asked James Barry to make sense of the company’s struggling web server business. Barry found that IBM…
Read More » -
Software Development
Using ELK (elasticsearch + logstash + kibana) to aggregate cassandra and spark logs
On one of my current projects we are using Cassandra and Spark Streaming to do some somewhat-close-to-real time analytics. The…
Read More » -
DevOps
Spark Monitoring: How to Handle 10B Requests a Day
Taboola’s Spark monitoring architecture for handling 10B+ daily user events They say unicorns don’t exist, but of course you know…
Read More » -
Software Development
Spark and Cluster Computing
In this post I’ll mention the first paper at which Spark is introduced, Spark: Cluster Computing with Working Sets. This post…
Read More » -
Scala
Spark: Generating CSV files to import into Neo4j
About a year ago Ian pointed me at a Chicago Crime data set which seemed like a good fit for…
Read More » -
Enterprise Java
Streaming Big Data: Storm, Spark and Samza
There are a number of distributed computation systems that can process Big Data in real time or near-real time. This…
Read More » -
Scala
Spark: Write to CSV file
A couple of weeks ago I wrote how I’d been using Spark to explore a City of Chicago Crime data…
Read More » -
Scala
Spark: Write to CSV file with header using saveAsFile
In my last blog post I showed how to write to a single CSV file using Spark and Hadoop and…
Read More »