Big Data Engineer jobs in Maharashtra

Purpose Design and develop scalable ETL pipelines, APIs, and automations for big data processing in an on-premise Hadoop/Spark/Airflow environment, focusing on real-time log enrichment and exposure via APIs for a visualization app. Take ownership of proposing and implementing solutions for data flow, performance, and integration challenges. Key Responsibilities - Architect and implement...

About Us HG Insights is the global leader in technology intelligence, delivering actionable AI driven insights through advanced data science and scalable big data solutions. What You’ll Do: - Design, build, and optimize large-scale distributed data pipelines for processing billions of unstructured documents using Databricks, Apache Spark, and cloud-native big data tools - Architect and scale...

Come work at a place where innovation and teamwork come together to support the most exciting missions in the world!This is a great opportunity to be an integral part of a team building Qualys next generation Micro-Services based technology platform processing over a Billion transactions and terabytes of data per day, leverage open source technologies, and work on challenging and...

About Us HG Insights is the global leader in technology intelligence, delivering actionable AI driven insights through advanced data science and scalable big data solutions. What You’ll Do: - Design, build, and optimize large-scale distributed data pipelines for processing billions of unstructured documents using Databricks, Apache Spark, and cloud-native big data tools - Architect and scale...

Purpose Design and develop scalable ETL pipelines, APIs, and automations for big data processing in an on-premise Hadoop/Spark/Airflow environment, focusing on real-time log enrichment and exposure via APIs for a visualization app. Take ownership of proposing and implementing solutions for data flow, performance, and integration challenges. Key Responsibilities - Architect and implement...

Purpose Design and develop scalable ETL pipelines, APIs, and automations for big data processing in an on-premise Hadoop/Spark/Airflow environment, focusing on real-time log enrichment and exposure via APIs for a visualization app. Take ownership of proposing and implementing solutions for data flow, performance, and integration challenges. Key Responsibilities - Architect and implement...

About Us HG Insights is the global leader in technology intelligence, delivering actionable AI driven insights through advanced data science and scalable big data solutions. What You’ll Do: - Design, build, and optimize large-scale distributed data pipelines for processing billions of unstructured documents using Databricks, Apache Spark, and cloud-native big data tools - Architect and scale...

Purpose Design and develop scalable ETL pipelines, APIs, and automations for big data processing in an on-premise Hadoop/Spark/Airflow environment, focusing on real-time log enrichment and exposure via APIs for a visualization app. Take ownership of proposing and implementing solutions for data flow, performance, and integration challenges. Key Responsibilities - Architect and implement...

About Us HG Insights is the global leader in technology intelligence, delivering actionable AI driven insights through advanced data science and scalable big data solutions. What You’ll Do: - Design, build, and optimize large-scale distributed data pipelines for processing billions of unstructured documents using Databricks, Apache Spark, and cloud-native big data tools - Architect and scale...

Purpose Design and develop scalable ETL pipelines, APIs, and automations for big data processing in an on-premise Hadoop/Spark/Airflow environment, focusing on real-time log enrichment and exposure via APIs for a visualization app. Take ownership of proposing and implementing solutions for data flow, performance, and integration challenges. Key Responsibilities - Architect and implement...

About Us HG Insights is the global leader in technology intelligence, delivering actionable AI driven insights through advanced data science and scalable big data solutions. What You’ll Do: - Design, build, and optimize large-scale distributed data pipelines for processing billions of unstructured documents using Databricks, Apache Spark, and cloud-native big data tools - Architect and scale...

About Us HG Insights is the global leader in technology intelligence, delivering actionable AI driven insights through advanced data science and scalable big data solutions. What You’ll Do: - Design, build, and optimize large-scale distributed data pipelines for processing billions of unstructured documents using Databricks, Apache Spark, and cloud-native big data tools - Architect and scale...

Purpose Design and develop scalable ETL pipelines, APIs, and automations for big data processing in an on-premise Hadoop/Spark/Airflow environment, focusing on real-time log enrichment and exposure via APIs for a visualization app. Take ownership of proposing and implementing solutions for data flow, performance, and integration challenges. Key Responsibilities - Architect and implement...

About Us HG Insights is the global leader in technology intelligence, delivering actionable AI driven insights through advanced data science and scalable big data solutions. What You’ll Do: - Design, build, and optimize large-scale distributed data pipelines for processing billions of unstructured documents using Databricks, Apache Spark, and cloud-native big data tools - Architect and scale...

Purpose Design and develop scalable ETL pipelines, APIs, and automations for big data processing in an on-premise Hadoop/Spark/Airflow environment, focusing on real-time log enrichment and exposure via APIs for a visualization app. Take ownership of proposing and implementing solutions for data flow, performance, and integration challenges. Key Responsibilities - Architect and implement...

Purpose Design and develop scalable ETL pipelines, APIs, and automations for big data processing in an on-premise Hadoop/Spark/Airflow environment, focusing on real-time log enrichment and exposure via APIs for a visualization app. Take ownership of proposing and implementing solutions for data flow, performance, and integration challenges. Key Responsibilities - Architect and implement...

About Us HG Insights is the global leader in technology intelligence, delivering actionable AI driven insights through advanced data science and scalable big data solutions. What You’ll Do: - Design, build, and optimize large-scale distributed data pipelines for processing billions of unstructured documents using Databricks, Apache Spark, and cloud-native big data tools - Architect and scale...

Purpose Design and develop scalable ETL pipelines, APIs, and automations for big data processing in an on-premise Hadoop/Spark/Airflow environment, focusing on real-time log enrichment and exposure via APIs for a visualization app. Take ownership of proposing and implementing solutions for data flow, performance, and integration challenges. Key Responsibilities - Architect and implement...

Purpose Design and develop scalable ETL pipelines, APIs, and automations for big data processing in an on-premise Hadoop/Spark/Airflow environment, focusing on real-time log enrichment and exposure via APIs for a visualization app. Take ownership of proposing and implementing solutions for data flow, performance, and integration challenges. Key Responsibilities - Architect and implement...

Purpose Design and develop scalable ETL pipelines, APIs, and automations for big data processing in an on-premise Hadoop/Spark/Airflow environment, focusing on real-time log enrichment and exposure via APIs for a visualization app. Take ownership of proposing and implementing solutions for data flow, performance, and integration challenges. Key Responsibilities - Architect and implement...