Search Results for: spark
-
Enterprise Java
Native microservices with SparkJava and Graal
Microservices written with SparkJava are just plain Java code using a standard Java library. No annotation magic, just code. The…
Read More » -
Enterprise Java
Spark Run local design pattern
Many spark applications have now become legacy applications and it is very hard to enhance, test & run locally. Spark…
Read More » -
Enterprise Java
Exploring the Spline Data Tracker and Visualization tool for Apache Spark (Part 2)
In part 1 we have learned how to test data lineage info collection with Spline from a Spark shell. The same can…
Read More » -
Enterprise Java
Exploring the Spline Data Tracker and Visualization tool for Apache Spark (Part 1)
One interesting and promising Open Source project that caught my attention lately is Spline, a data lineage tracking and visualization tool…
Read More » -
Enterprise Java
Insights from Spark UI
As continuation of anatomy-of-apache-spark-job post i will share how you can use Spark UI for tuning job. I will continue with same…
Read More » -
Enterprise Java
Anatomy of Apache Spark Job
Apache Spark is general purpose large scale data processing framework. Understanding how spark executes jobs is very important for getting most of…
Read More » -
Software Development
Spark Microservices
As continuation of big data query system blog, i want to share more techniques for building Analytics engine. Take a problem…
Read More » -
Enterprise Java
Custom Logs in Apache Spark
Have you ever felt the frustration of Spark job that runs for hours and it fails due to infra issue.…
Read More » -
Enterprise Java
Optimizing Spark Job Performance With Apache Ignite (Part 1)
Apache Ignite’s memory-centric architecture enables efficient RDD sharing with IgniteContext and IgniteRDD to share RDDs between Spark apps. Come see…
Read More »