Big Data Engineer jobs in Chennai District

About Us HG Insights is the global leader in technology intelligence, delivering actionable AI driven insights through advanced data science and scalable big data solutions. What You’ll Do: - Design, build, and optimize large-scale distributed data pipelines for processing billions of unstructured documents using Databricks, Apache Spark, and cloud-native big data tools - Architect and scale...

Purpose Design and develop scalable ETL pipelines, APIs, and automations for big data processing in an on-premise Hadoop/Spark/Airflow environment, focusing on real-time log enrichment and exposure via APIs for a visualization app. Take ownership of proposing and implementing solutions for data flow, performance, and integration challenges. Key Responsibilities - Architect and implement...

Job Description– Big Data EngineerExperience: 8+ YearsLocation: Chennai & GurgaonMode: HybridWe are looking for a Big Data Engineer with strong experience in SQL, Hive, ETL pipelines, PySpark, and GCP to design and build scalable data solutions for large, complex datasets.Key Responsibilities- Develop and optimize Big Data pipelines using SQL, Hive, PySpark, and ETL frameworks.- Build and...

Required Skills: - 3 + Years Of an experience in Big Data Admin. - Should have hands-on Experience in Big Data Stack ,Apache Spark ,Azure Cloud: HDInsight, Fabric, ADF, Azure Compute, Storage, Networking Troubleshooting Skills

We are looking for a Lead GCP Big Data Engineer with strong expertise in building scalable data pipelines, ETL/ELT workflows, and big data solutions on Google Cloud Platform. This role combines technical leadership with hands-on development, driving best practices across data engineering initiatives and mentoring team members. Key Responsibilities:- - Design, develop, and maintain robust...

About the Team The Data Platform Tech Team at Navi is instrumental in enabling data-driven decision-making across the organization. We build and manage the core infrastructure and tools required to collect, store, process, and analyze data at scale. We operate one of the most robust data platforms in Indian fintech — managing over 10 petabytes of data across 25,000+ tables. Our systems ensure...

Organization:- Leading Global Management Consulting Organization (One of the BIG 3) Role :- Data Engineering Sr Manager Location :- Gurugram Exp:- 10 + Years Skills :- 70% hands on technical + 30% People management What You'll Do As a Senior Manager - Data Engineering to spearhead our data engineering team that focuses on building and maintaining HR functional data products. This role...

Job Title: Data Engineer (Data Warehouse Focus) Domain: BFSI Experience: 5-8 Years Location: Remote Employment Type: Full-Time Job Summary Seeking a Data Engineer with strong expertise in Snowflake, Python, Airflow, and SQL to design, build, and maintain scalable cloud-based data warehouse solutions for BFSI platforms. Key Responsibilities - Design and develop data warehouse architectures...

About Albertsons Companies Inc.: As a leading food and drug retailer in the United States, Albertsons Companies, Inc. operates over 2,200 stores across 35 states and the District of Columbia. Our well-known banners across the United States, including Albertsons, Safeway, Vons, Jewel-Osco and others, serve more than 36 million U.S customers each week. We build and shape technology solutions that...

We are seeking a skilled and innovative Data Science Engineer to join our dynamic team. You will be responsible for designing, developing, and deploying scalable data science solutions to address real-world problems. The ideal candidate is experienced in building end-to-end machine learning pipelines, integrating data science solutions into production systems, and working collaboratively with...

Job Overview: We are looking for a skilled and motivated Lead Data Engineer with strong experience in Python programming and Google Cloud Platform (GCP) to join our data engineering team. The ideal candidate will be responsible for requirements gathering, designing, architecting the solution, developing, and maintaining robust and scalable ETL (Extract, Transform, Load) & ELT data pipelines. The...

Company Description Texplorers Inc. is a leader in digital transformation for global enterprises, with over 15 years of experience in cloud technology and AI expertise. The company focuses on empowering businesses to scale efficiently and continuously improve through their innovation ecosystem. Texplorers Inc. is committed to innovation, sustainability, and inclusion, ensuring perpetual learning...

Position: Pyspark Data Engineer Experience: 5+ yrs hands on experience Location: Bangalore,Pune,Chennai,Gurugram Notice Period-0 to 30 Days Required Technical skill-Pyspark, python , Data, Spark Mode of Interview: Weekend Virtual Mode Date of Interview: 24-Jan-2026(Saturday) Roles & Responsibilities: - Good work experience on Big Data Platforms like Hadoop, Spark, Scala, Hive, Impala,...

Role: Azure data Engineer 🔹 Relevant Experience: 5+ years only 🔹 Location: Pan India (Remote) 🔹 Notice Period: Immediate Joiners/15 days only If you’re passionate about Azure and Data Engineering, this is your chance to be a part of something amazing! 📧 Apply Now: Send your updated resume to vaishnavi.r@method-hub.com 📩 Job Description: Primary Responsibilities - · Create and maintain...

For an international project in Chennai, we are urgently looking for a Full Remote Senior Azure Data Engineer, who will build data pipeline for enterprise search applications using ADF and Databricks. We are looking for a motivated contractor. Candidates need tbe fluent in English. Tasks and responsibilities: - Build data integration feeds according to the requirement; - Review the business...

Where you come in: - You will work ongoing support activities and support project efforts as needed - You triage identified issues across Account source platforms, integrations and Customer Data Hub - You will analyze and triage API messages as part of ongoing platform support - You perform CDH (Customer Data Hub) initial data loads and data cleanup working with Postman, Python, SQL, Big Query...

Job Title: Senior Data Engineer – L2Experience Level: 3+ YearsLocations: Chennai | Madurai | CoimbatoreAbout the Role:We are seeking a results-driven and technically proficient Senior Data Engineer (L2) to play a dual role in both solutioning-based initiatives and interview-driven ODC projects. This position is ideal for individuals who thrive in high-impact environments, possess strong...

About the CompanyJMAN Group is a fast-growing data engineering & data science consultancy. We work primarily with Private Equity Funds and their Portfolio Companies to create commercial value using Data & Artificial Intelligence. In addition, we also work with growth businesses, large corporates, multinationals, and charities.We are headquartered in London with Offices in New York, London and...

Lead Engineer - Big Data About us: Gracenote is the content data business unit of Nielsen that powers innovative entertainment experiences for the world s leading media companies. Our entertainment metadata and connected IDs deliver advanced content navigation and discovery to connect consumers to the content they love and discover new ones. With a global footprint, Gracenote provides...

Responsibilities: - Create and maintain optimal data pipeline architecture; assemble large, complex data sets that meet functional / non-functional requirements. - Design the right schema to support the functional requirement and consumption patter. - Design and build production data pipelines from ingestion to consumption. - Create necessary preprocessing and postprocessing for various forms of...