In this post we will walk through the process of writing a Spark DataFrame to an Elasticsearch index.
[Read More]
Running Spark SQL applications with a remote Hive cluster
Connect your Spark cluster to a remote Hive cluster
Detecting sensor failure using the MQTT protocol, an IoT Proof of Concept
Motivation IoT technology is beginning to witness wide scale adoption in the consumer as well as industrial environments. In a typical enterprise scenario, you may have a large number of inexpensive sensor nodes interacting with machinery and sending data to Gateway nodes. These Gateway nodes are responsible for aggregating sensor...
[Read More]
Java 8 features I learnt while writing an access log summarizer
Java 8 has been out for quite some time now and I thought, the best way to get up-to speed with the new features, is to dive in head first and learn along the way, while I code a solution to a real world problem.
[Read More]
Profiling with Java Agents - Part 2
Using an agent to extract custom metrics.
In-case you haven’t read Part 1, you can find it here.
[Read More]
Profiling with Java Agents - Part 1: A Hello World Example
Simplified Profiling with Java Agents
The Java Agent technology has been around since JDK 1.5. Here we will build a simple profiler which will instrument our Java program and give us method execution count metrics. The profiler will be run as a Java Agent.
[Read More]
Time-Series Scatter Plot of Server Requests using Python
In this post I will attempt to explain how I used Pandas and Matplotlib to quickly generate server requests reports on a daily basis.
[Read More]