Big Data Engineer jobs in Pune

Come work at a place where innovation and teamwork come together to support the most exciting missions in the world! This is a great opportunity to be an integral part of a team building Qualys next generation Micro-Services based technology platform processing over a Billion transactions and terabytes of data per day, leverage open source technologies, and work on challenging and...

Required Skills: - 3 + Years Of an experience in Big Data Admin. - Should have hands-on Experience in Big Data Stack ,Apache Spark ,Azure Cloud: HDInsight, Fabric, ADF, Azure Compute, Storage, Networking Troubleshooting Skills

Purpose Design and develop scalable ETL pipelines, APIs, and automations for big data processing in an on-premise Hadoop/Spark/Airflow environment, focusing on real-time log enrichment and exposure via APIs for a visualization app. Take ownership of proposing and implementing solutions for data flow, performance, and integration challenges. Key Responsibilities - Architect and implement...

Job Summary: We are seeking a skilled Data Quality Engineer to ensure the accuracy, reliability, and integrity of our data pipelines and workflows. The ideal candidate will have hands-on experience in data engineering concepts, with a strong focus on quality testing, validation, and pipeline orchestration. Key Responsibilities: Design, develop, and execute data quality test cases to validate...

Title – Senior Data Engineer Position – Contract with Opportunity for Full Time Conversion Location – Remote Work Salary – 1-2 Lakhs (Monthly) Working hours should be 6:30 am - 2:30 pm EST (USA) Qualifications - Bachelor’s or Master degree in Computer Science, Information Systems, or related field. - 6+ years experience architecting and building large scale data platforms - Experience...

TCS present an excellent opportunity for GCP Data Engineer Job Location: Pune Experience required: 5-12 yrs Skills: GCP services, Dataproc, Dataflow, pub/sub, Cloud functions, Cloud composer, Big Query, Big Table Walk-in Interview: Tata Consultancy Services Ltd, Sahyadri Park, Plot No. 2 & 3, Phase 3, Rajiv Gandhi Infotech Park, Maan, Hinjawadi, Pune - 411057 Date: 10-Jan-26...

Position: Data Engineer(IDMC/ PowerCenter) Location: Pune Experience: Min 6+Years Specific Requirements: - Development, maintenance, and enhancement of Data Pipelines (ETL/ELT) and processes with thorough knowledge of star/snowflake schemas - Hands on experience in PowerCenter Developer/IDMC Data Integration - Experience in DW Production Support / troubleshooting data or pipeline issues -...

Purpose of the Position: You will be a critical member of the InfoCepts Cloud Data Architect Team. This position requires a sound knowledge on Big Data using Cloud technologies such as such as Databricks, EMR, Athena, PySpark, S3, AWS Lambda etc. Strong foundation on database concepts and SQL is also required. / Bangalore/Chennai Type of Employment: Full time Key Result Areas and...

Job Title - Staff / Senior Data Engineer Job Location - Pune, Maharashtra Experience - 4 to 10 years What You’ll Do: In this role, you will take the lead in designing, building, and optimizing data pipelines, ensuring high-quality data integration and real-time analytics. As a Senior Staff Engineer, you will mentor and guide a team of data engineers, collaborate with cross-functional teams,...

Location – Pune/Chennai Exp - 6 to 9 Requirements Technology: - Big Data (Hadoop, Hive, Spark, Scala, PLSQL/ No SQL Database) Knowledge/Experience (Must): · 6-9 years of experience in Hadoop/big data technologies. · Experience with Spark/Storm/Kafka or equivalent streaming/batch processing and event based messaging. · Relational and NoSQL database integration and data distribution...

For an international project in Chennai, we are urgently looking for a Full Remote Senior Azure Data Engineer, who will build data pipeline for enterprise search applications using ADF and Databricks. We are looking for a motivated contractor. Candidates need tbe fluent in English. Tasks and responsibilities: - Build data integration feeds according to the requirement; - Review the business...

Who we are? Searce means ‘a fine sieve’ & indicates ‘to refine, to analyze, to improve’. It signifies our way of working: To improve to the finest degree of excellence, ‘solving for better’ every time. Searcians are passionate improvers & solvers who love to question the status quo. The primary purpose of all of us, at Searce, is driving intelligent, impactful & futuristic business outcomes...

About the Organization- Impetus Technologies is a digital engineering company focused on delivering expert services and products to help enterprises achieve their transformation goals. We solve the analytics, AI, and cloud puzzle, enabling businesses to drive unmatched innovation and growth. Founded in 1991, we are cloud and data engineering leaders providing solutions to fortune 100...

We are seeking a skilled Azure Data Engineer with hands-on experience in modern data engineering tools and platforms within the Azure ecosystem. The ideal candidate will have a strong foundation in data integration, transformation, and migration, along with a passion for working on complex data migration projects. Job Title: Azure Data Engineer Location: Remote work Work Timings: 5:00 PM to...

Description EPAM is a leading global provider of digital platform engineering and development services. We are committed to having a positive impact on our customers, our employees, and our communities. We embrace a dynamic and inclusive culture. Here you will collaborate with multi-national teams, contribute to a myriad of innovative projects that deliver the most creative and cutting-edge...

Role : Lead Big Data Engineer Experience: 9 - 11 Years Location: Pune About Digit88 Digit88 empowers digital transformation for innovative and high growth B2B and B2C SaaS companies as their trusted offshore software product engineering partner! We are a lean mid-stage software company, with a team of 75+ fantastic technologists, backed by executives with deep understanding of and extensive...

Role Summary We are seeking an experienced Senior Azure Data Engineer to design and implement robust data solutions on Azure. The role involves building scalable ETL/ELT pipelines, working with big-data processing frameworks, and collaborating with architects to deliver cloud-based data warehouse solutions. The ideal candidate will have strong hands-on expertise in Azure data services and modern...

Description EPAM is a leading global provider of digital platform engineering and development services. We are committed to having a positive impact on our customers, our employees, and our communities. We embrace a dynamic and inclusive culture. Here you will collaborate with multi-national teams, contribute to a myriad of innovative projects that deliver the most creative and cutting-edge...

Description : We are seeking a talented Lead Big Data Engineer to deliver roadmap features of Unified Asset Inventory. This is a great opportunity to be an integral part of a team building Qualys next generation Micro-Services based platform processing over a 100 million transactions and terabytes of data per day, leverage open-source technologies, and work on challenging and business-impacting...

Position: Solution Architect - Cloud and Data Engineering Purpose of the Position: Purpose of this role is to drive growth of Cloud & Data Engineering business at Infocepts as a Solution Architect. Major responsibilities under this role would be to engage with clients in advisory & consulting, advance solutions, support presales as a solution architect, build capabilities, drive research &...