Aditya PimparkarAdding Error stack trace and filter options in Log4j Kafka AppenderIn the previous article, we discussed how to direct spark logs to kafka but one issue with…Mar 11, 2021Mar 11, 2021
Aditya PimparkarRedirecting Spark logs to KafkaSpark logs can be redirected to Kafka which can be further used for analysis. These logs can be fed from kafka to elastic search and…Feb 19, 2021Feb 19, 2021
Aditya PimparkarState Transformation in SparkSpark Streaming is able to handle state-based operations, i.e. operations containing a state susceptible to be modified in subsequent…Aug 23, 2020Aug 23, 2020
Aditya PimparkarSpark integration with kafka (Streaming)Apache Kafka — Spark structured streaming is one of the best combinations for building real time applications. In the previous article, we…Aug 16, 2020Aug 16, 2020
Aditya PimparkarSpark Integration With kafka(Batch)Spark integration with kafka (Batch)Aug 9, 2020Aug 9, 2020
