Big Data Engineer jobs in Madurai District

Purpose Design and develop scalable ETL pipelines, APIs, and automations for big data processing in an on-premise Hadoop/Spark/Airflow environment, focusing on real-time log enrichment and exposure via APIs for a visualization app. Take ownership of proposing and implementing solutions for data flow, performance, and integration challenges. Key Responsibilities - Architect and implement...

About UsHG Insights is the global leader in technology intelligence, delivering actionable AI driven insights through advanced data science and scalable big data solutions.What You’ll Do:Design, build, and optimize large-scale distributed data pipelines for processing billions of unstructured documents using Databricks, Apache Spark, and cloud-native big data toolsArchitect and scale...

Required Skills: - 3 + Years Of an experience in Big Data Admin. - Should have hands-on Experience in Big Data Stack ,Apache Spark ,Azure Cloud: HDInsight, Fabric, ADF, Azure Compute, Storage, Networking Troubleshooting Skills

Dear Candidate, Greetings from TATA Consultancy Services!! Thank you for expressing your interest in exploring a career possibility with the TCS Family. Hiring For:- Big Data with Pyspark/Spark, Scala Location: Mumbai - Olympus Experience: 5+years Required Technical Skill Set Pyspark, Hive, Hbase Must-Have Spark, Pyspark, Hive, Hbase, Kafka Good-to-Have Agile SN Responsibility of /...

- Core Frameworks: Apache Spark, PySpark, Airflow, NiFi, Kafka, Hive, Iceberg, Oozie - Programming Languages: Python, Scala, Java - Data Formats & Storage: Parquet, ORC, Avro, S3, HDFS - Orchestration & Workflow: Airflow, DBT - Performance Optimization: Spark tuning, partitioning strategies, caching, YARN/K8s resource tuning - Testing & Validation: Great Expectations, Deequ, SQL-based QA...

Pune/HYD "Primary Skills 6-8yrs of Experience in working as bigdata developer/supporting environemnts Strong knowledge in Unix/BigData Scripting Strong understanding of BigData (CDP/Hive) Environment Hands-on with GitHub and CI-CD implementations. Attitude to learn / understand ever task doing with reason Ability to work independently on specialized assignments within the context of...

Job Title: Apprentice Leader – Data Engineering Experience: 4–7 years Location: Bangalore (Onsite) Employment Type: Full-Time Overview Our client – one of the largest data science companies – is seeking to hire a Data Engineer (Data Platform & DevOps) to design, build, and operate scalable data and ML platforms on AWS, Azure, or GCP. This role blends strong data engineering fundamentals with...

About the Role We are seeking an experienced Data Engineer to design, build, and optimize scalable data architectures and pipelines that power business insights across our EdTech platform. The ideal candidate will bring strong expertise in data engineering, cloud data platforms, BI tools, and data governance, along with the ability to work cross-functionally to support data-driven...

About Business Unit: The Automotive Practice at Epsilon is a rapidly growing team, driving growth for major players in the automotive industry - from Original Equipment Manufacturers (OEMs) to dealerships across North America. Part of a 1,600-member multinational team, the practice provides the automotive world’s largest service reminder platform, alongside agency services and digital media...

About the job Job Description Hiring: Data Engineer | Remote | Full-Time | Immediate Joiner Company: Natlov Technologies Pvt. Ltd Experience: 4 years CTC: APCS Natlov Technologies Pvt. Ltd is looking for a Data Engineer with strong AWS expertise and working experience in Azure. In this role, you will design, build, and optimize scalable data pipelines across multi-cloud environments using...

About the Company: Tredence focuses on last-mile delivery of powerful insights into profitable actions by uniting its strengths in business analytics, data science and software engineering. The largest companies across industries are engaging with us and deploying their prediction and optimization solutions at scale. Head quartered in the San Francisco Bay Area, we serve clients in the US,...

About Albertsons Companies Inc.: As a leading food and drug retailer in the United States, Albertsons Companies, Inc. operates over 2,200 stores across 35 states and the District of Columbia. Our well-known banners across the United States, including Albertsons, Safeway, Vons, Jewel-Osco and others, serve more than 36 million U.S customers each week. We build and shape technology solutions that...

Role: Azure data Engineer 🔹 Relevant Experience: 5+ years only 🔹 Location: Pan India (Remote) 🔹 Notice Period: Immediate Joiners/15 days only If you’re passionate about Azure and Data Engineering, this is your chance to be a part of something amazing! 📧 Apply Now: Send your updated resume to vaishnavi.r@method-hub.com 📩 Job Description: Primary Responsibilities - · Create and maintain...

Organization:- Leading Global Management Consulting Organization (One of the BIG 3) Role :- Data Engineering Sr Manager Location :- Gurugram Exp:- 10 + Years Skills :- 70% hands on technical + 30% People management What You'll Do As a Senior Manager - Data Engineering to spearhead our data engineering team that focuses on building and maintaining HR functional data products. This role...

About the Team The Data Platform Tech Team at Navi is instrumental in enabling data-driven decision-making across the organization. We build and manage the core infrastructure and tools required to collect, store, process, and analyze data at scale. We operate one of the most robust data platforms in Indian fintech — managing over 10 petabytes of data across 25,000+ tables. Our systems ensure...

Job Title: Data Engineer (Data Warehouse Focus) Domain: BFSI Experience: 5-8 Years Location: Remote Employment Type: Full-Time Job Summary Seeking a Data Engineer with strong expertise in Snowflake, Python, Airflow, and SQL to design, build, and maintain scalable cloud-based data warehouse solutions for BFSI platforms. Key Responsibilities - Design and develop data warehouse architectures...

Job Summary: We are seeking a skilled Data Quality Engineer to ensure the accuracy, reliability, and integrity of our data pipelines and workflows. The ideal candidate will have hands-on experience in data engineering concepts, with a strong focus on quality testing, validation, and pipeline orchestration. Key Responsibilities: Design, develop, and execute data quality test cases to validate...

Required Skills & Experience Bachelor’s degree (or equivalent experience) in Computer Science, Mathematics, Statistics, Physics, or a related quantitative field. Proficiency in Python and strong expertise in Scala (preferred) or Java. Hands-on experience with Big Data tools, especially Spark and familiarity with the Hadoop ecosystem. Proficiency in building ETL pipelines and working with AWS...

Greetings from TCS! Job Title: Big Data with Pyspark/Spark, Scala Walkin Interview Date: 24th Jan ‘26 Walkin Location: TCS Siruseri, Siruseri SEZ Unit”, Plot No.1/G1, SIPCOT I. T Park, ATL Siruseri, Navalur Walkin Time: 9am-1pm Experience Range: 5+ yrs Job description: TCS has always been in the spotlight for being adept in the next big technologies. What we can offer you is a space to...

TCS is Hiring For GCP Data Engineer - BigQuery Experience: 5 YRS- 10YRS Location: CHENNAI, BANGALORE, HYDERABHAD Role : Data Engineer Skill :Big Data, Spark, HDFS, Kafka, Scala, AWS, Azure, GCP, ETL, Hadoop, Hive etc. JOB DESCRIPTION : Must-Have** • Strong experience in programming languages such as Python, Java, or Scala for data manipulation and engineering tasks. • Expertise in SQL and...