Big Data Engineer jobs in Chengalpattu

About UsHG Insights is the global leader in technology intelligence, delivering actionable AI driven insights through advanced data science and scalable big data solutions.What You’ll Do:Design, build, and optimize large-scale distributed data pipelines for processing billions of unstructured documents using Databricks, Apache Spark, and cloud-native big data toolsArchitect and scale...

PurposeDesign and develop scalable ETL pipelines, APIs, and automations for big data processing in an on-premise Hadoop/Spark/Airflow environment, focusing on real-time log enrichment and exposure via APIs for a visualization app. Take ownership of proposing and implementing solutions for data flow, performance, and integration challenges.Key ResponsibilitiesArchitect and implement ETL/ELT...

Required Skills:3 + Years Of an experience in Big Data Admin.Should have hands-on Experience in Big Data Stack ,Apache Spark ,Azure Cloud: HDInsight, Fabric, ADF, Azure Compute, Storage, Networking Troubleshooting Skills

Dear Candidate,Greetings from TATA Consultancy Services!!Thank you for expressing your interest in exploring a career possibility with the TCS Family.Hiring For:- Big Data with Pyspark/Spark, ScalaLocation: Mumbai - OlympusExperience: 5+yearsRequired Technical Skill Set Pyspark, Hive, HbaseMust-Have Spark, Pyspark, Hive, Hbase, KafkaGood-to-Have AgileSN Responsibility of / Expectations from the...

About the Company : Tredence focuses on last-mile delivery of powerful insights into profitable actions by uniting its strengths in business analytics, data science and software engineering. The largest companies across industries are engaging with us and deploying their prediction and optimization solutions at scale. Head quartered in the San Francisco Bay Area, we serve clients in the US,...

Job Title: Apprentice Leader – Data EngineeringExperience: 4 –7 yearsLocation: Bangalore (Onsite)Employment Type: Full-TimeOverviewOur client – one of the largest data science companies – is seeking to hire a Data Engineer (Data Platform & DevOps) to design, build, and operate scalable data and ML platforms on AWS, Azure, or GCP . This role blends strong data engineering fundamentals with DevOps...

Responsibilities:Create and maintain optimal data pipeline architecture; assemble large, complex data sets that meet functional / non-functional requirements.Design the right schema to support the functional requirement and consumption patter.Design and build production data pipelines from ingestion to consumption.Create necessary preprocessing and postprocessing for various forms of data for...

Organization:- Leading Global Management Consulting Organization (One of the BIG 3)Role :- Data Engineering Sr ManagerLocation :- GurugramExp:- 10 + YearsSkills :- 70% hands on technical + 30% People managementWhat You'll DoAs a Senior Manager - Data Engineering to spearhead our data engineering team that focuses on building and maintaining HR functional data products. This role involves leading...

Job Summary:We are seeking a skilled Data Quality Engineer to ensure the accuracy, reliability, and integrity of our data pipelines and workflows. The ideal candidate will have hands-on experience in data engineering concepts, with a strong focus on quality testing, validation, and pipeline orchestration.Key Responsibilities:Design, develop, and execute data quality test cases to validate data...

Required Skills & ExperienceBachelor’s degree (or equivalent experience) in Computer Science, Mathematics, Statistics, Physics, or a related quantitative field.Proficiency in Python and strong expertise in Scala (preferred) or Java.Hands-on experience with Big Data tools, especially Spark and familiarity with the Hadoop ecosystem.Proficiency in building ETL pipelines and working with AWS services...

Job Overview:We are looking for a skilled and motivated Lead Data Engineer with strong experience in Python programming and Google Cloud Platform (GCP) to join our data engineering team. The ideal candidate will be responsible for requirements gathering, designing, architecting the solution, developing, and maintaining robust and scalable ETL (Extract, Transform, Load) & ELT data pipelines. The...

Role: Azure data EngineerRelevant Experience: 5+ years onlyLocation: Pan India (Remote)Notice Period: Immediate Joiners/15 days onlyIf you’re passionate about Azure and Data Engineering, this is your chance to be a part of something amazing!Apply Now: Send your updated resume to vaishnavi.r@method-hub.comJob Description:Primary Responsibilities -· Create and maintain data storage solutions...

Job Title: Data Engineer (Data Warehouse Focus)Domain: BFSIExperience: 5-8 YearsLocation: RemoteEmployment Type: Full-TimeJob SummarySeeking a Data Engineer with strong expertise in Snowflake, Python, Airflow, and SQL to design, build, and maintain scalable cloud-based data warehouse solutions for BFSI platforms.Key ResponsibilitiesDesign and develop data warehouse architectures and ETL/ELT...

For an international project in Chennai, we are urgently looking for a Full Remote Senior Azure Data Engineer, who will build data pipeline for enterprise search applications using ADF and Databricks.We are looking for a motivated contractor. Candidates need tbe fluent in English.Tasks and responsibilities:Build data integration feeds according to the requirement;Review the business requirements...

About Business Unit:The Automotive Practice at Epsilon is a rapidly growing team, driving growth for major players in the automotive industry - from Original Equipment Manufacturers (OEMs) to dealerships across North America. Part of a 1,600-member multinational team, the practice provides the automotive world’s largest service reminder platform, alongside agency services and digital media...

Job Title: Data EngineerLocation: Hyderabad, TelanganaEmployment Type: Full-time | On-site / HybridAbout the RoleWe are looking for a skilled and detail-oriented Data Engineer to design, build, and maintain scalable data pipelines and architectures that power analytics, reporting, and machine learning across the organization. You will play a key role in ensuring reliable, high-quality data is...

About the RoleWe are seeking an experienced Data Engineer to design, build, and optimize scalable data architectures and pipelines that power business insights across our EdTech platform. The ideal candidate will bring strong expertise in data engineering, cloud data platforms, BI tools , and data governance , along with the ability to work cross-functionally to support data-driven...

About the TeamThe Data Platform Tech Team at Navi is instrumental in enabling data-driven decision-making across the organization. We build and manage the core infrastructure and tools required to collect, store, process, and analyze data at scale.We operate one of the most robust data platforms in Indian fintech — managing over 10 petabytes of data across 25,000+ tables. Our systems ensure every...

Greetings from TCS!Job Title: Big Data with Pyspark/Spark, ScalaWalkin Interview Date: 24th Jan ‘26Walkin Location: TCS Siruseri, Siruseri SEZ Unit”, Plot No.1/G1, SIPCOT I. T Park, ATLSiruseri, NavalurWalkin Time: 9am-1pmExperience Range: 5+ yrsJob description:TCS has always been in the spotlight for being adept in the next big technologies. What we can offer you is a space to explore varied...

TCS is Hiring For GCP Data Engineer - BigQueryExperience: 5 YRS- 10YRSLocation: CHENNAI, BANGALORE, HYDERABHADRole : Data EngineerSkill :Big Data, Spark, HDFS, Kafka, Scala, AWS, Azure, GCP, ETL, Hadoop, Hive etc .JOB DESCRIPTION :Must-Have**• Strong experience in programming languages such as Python, Java, or Scala for data manipulation and engineering tasks. • Expertise in SQL and NoSQL...