Search Results for: spark
-
Software Development
Comparing SQL Functions and Performance with Apache Spark and Apache Drill
SQL engines for Hadoop differ in their approach and functionality. My focus for this blog post is to compare and…
Read More » -
Enterprise Java
MapReduce Design Patterns Implemented in Apache Spark
This blog is a first in a series that discusses some design patterns from the book MapReduce design patterns and…
Read More » -
Software Development
Introduction to Apache Spark with Examples and Use Cases
I first heard of Spark in late 2013 when I became interested in Scala, the language in which Spark is…
Read More » -
Enterprise Java
Spark 101: What Is It, What It Does, and Why It Matters
Recently, a new name has entered many of the conversations about big data. Some people see the popular newcomer Apache…
Read More » -
Software Development
SparkR: Add new column to data frame by concatenating other columns
Continuing with my exploration of the Land Registry open data set using SparkR I wanted to see which road in…
Read More » -
Software Development
Resource Allocation Configuration for Spark on YARN
In this blog post, I will explain the resource allocation configurations for Spark on YARN, describe the yarn-client and yarn-cluster…
Read More » -
Software Development
Spark Backend for Apache Gora
I’ve worked for Spark backend of Apache Gora as my GSoC 2015 project and finished it. At this blog post, I’ll…
Read More » -
Enterprise Java
Apache Spark: 5 Pitfalls You MUST Solve Before Changing Your Architecture
The top 5 things you need to know before moving to Apache Spark It seems like everyone’s only talking about…
Read More » -
Software Development
Spark, Parquet and S3 – It’s complicated
(A version of this post was originally posted in AppsFlyer’s blog. Also special thanks to Morri Feldman and Michael Spector…
Read More »