Big Data Engineer jobs in Lucknow

Required Skills: - 3 + Years Of an experience in Big Data Admin. - Should have hands-on Experience in Big Data Stack ,Apache Spark ,Azure Cloud: HDInsight, Fabric, ADF, Azure Compute, Storage, Networking Troubleshooting Skills

Purpose Design and develop scalable ETL pipelines, APIs, and automations for big data processing in an on-premise Hadoop/Spark/Airflow environment, focusing on real-time log enrichment and exposure via APIs for a visualization app. Take ownership of proposing and implementing solutions for data flow, performance, and integration challenges. Key Responsibilities - Architect and implement...

We are seeking a skilled Azure Data Engineer with hands-on experience in modern data engineering tools and platforms within the Azure ecosystem. The ideal candidate will have a strong foundation in data integration, transformation, and migration, along with a passion for working on complex data migration projects. Job Title: Azure Data Engineer Location: Remote work Work Timings: 5:00 PM to...

Title – Senior Data Engineer Position – Contract with Opportunity for Full Time Conversion Location – Remote Work Salary – 1-2 Lakhs (Monthly) Working hours should be 6:30 am - 2:30 pm EST (USA) Qualifications - Bachelor’s or Master degree in Computer Science, Information Systems, or related field. - 6+ years experience architecting and building large scale data platforms - Experience...

Job Summary: We are seeking a skilled Data Quality Engineer to ensure the accuracy, reliability, and integrity of our data pipelines and workflows. The ideal candidate will have hands-on experience in data engineering concepts, with a strong focus on quality testing, validation, and pipeline orchestration. Key Responsibilities: Design, develop, and execute data quality test cases to validate...

Job Title: Data Engineer (Data Warehouse Focus) Domain: BFSI Experience: 5-8 Years Location: Remote Employment Type: Full-Time Job Summary Seeking a Data Engineer with strong expertise in Snowflake, Python, Airflow, and SQL to design, build, and maintain scalable cloud-based data warehouse solutions for BFSI platforms. Key Responsibilities - Design and develop data warehouse architectures...

For an international project in Chennai, we are urgently looking for a Full Remote Senior Azure Data Engineer, who will build data pipeline for enterprise search applications using ADF and Databricks. We are looking for a motivated contractor. Candidates need tbe fluent in English. Tasks and responsibilities: - Build data integration feeds according to the requirement; - Review the business...

Where you come in: - You will work ongoing support activities and support project efforts as needed - You triage identified issues across Account source platforms, integrations and Customer Data Hub - You will analyze and triage API messages as part of ongoing platform support - You perform CDH (Customer Data Hub) initial data loads and data cleanup working with Postman, Python, SQL, Big Query...

Title: Data Engineer Duration: 6 Months (with possible extension) Experience- 10+ years Work Location: Remote Screening Checklist: - Proficiency in interpreting data transformation logic written in T-SQL and implementing equivalent processes within Databricks - Ability to design and implement data ingestion pipelines using Azure Data Factory (from source to RAW layer) - Basic knowledge of C#...

We are seeking a Data Engineering Consultant with 9+ years of experience in designing and delivering modern data platforms for global clients. The role requires strong hands-on expertise in Snowflake, Databricks, and ETL/ELT tools such as Fivetran and Alteryx, along with experience on cloud platforms (AWS, Azure, or GCP). Role Overview We are seeking a Data Engineering Consultant to lead and...

Engineer the Data Backbone for AI with goML At goML, we build modern Generative AI, AI/ML, and Data Engineering solutions that help enterprises turn data into intelligent, scalable systems. Our mission is to bridge advanced data platforms with real-world business needs—enabling faster insights, smarter decisions, and AI-ready foundations. We’re looking for a Data Engineer (AWS) to join our...

About the Project: We are looking for a skilled engineer for one of our clients to join a dynamic engineering team working on a high-impact tax reporting platform. The primary objective of this project is to modernize and significantly accelerate Excel-based report generation, reducing processing time from minutes to seconds. The role involves ingesting data from multiple upstream systems,...

Job Title: Datacenter Engineer Company: Estarta Partner/Client: Cisco Work Location: Remote – India Job Summary Estarta is seeking a skilled Datacenter Engineer to support Cisco’s Customer Delivery Engineering function. The role focuses on delivering high-quality technical solutions, resolving complex issues, and driving technology adoption across large-scale environments. The ideal...

Sikich India is seeking an experienced Data Engineer to join our Data & AI practice. You will design, build, and optimize end-to-end data solutions using Microsoft’s data platforms, including Microsoft Fabric, Azure Synapse Analytics, Databricks, and Power BI. Your work will involve implementing contemporary data architecture patterns (e.g., medallion, DataMesh, Zone-Based, or Lambda, etc...),...

Job Title: Data Engineer – Manufacturing Experience: 5+ Years Location: Remote (India) Key Skills: AWS Glue, EMR, Medallion Architecture, ERP Tools (Oracle ERP, SAP ERP, JD Edwards) Job Description: We are seeking a Manufacturing Domain Data Engineer with hands-on experience in building scalable data pipelines on AWS. The role focuses on implementing Medallion Architecture and integrating...

World Wide Technology (WWT), a global technology integrator and supply chain solutions provider. WWT employs more than 10,000 people worldwide and operates in more than 2 million square feet of state-of-the-art warehousing, distribution, and integration space strategically located worldwide. WWT ranked on Glassdoor's Best Places to Work & on Fortune's 100 Best Companies to Work For list for the...

𝐏𝐨𝐬𝐢𝐭𝐢𝐨𝐧: AI Data Engineer 𝐄𝐦𝐩𝐥𝐨𝐲𝐦𝐞𝐧𝐭 𝐓𝐲𝐩𝐞: Full-Time with Cogent IBS 𝐖𝐨𝐫𝐤 𝐌𝐨𝐝𝐞: Remote 𝐍𝐞𝐞𝐝 𝐫𝐞𝐬𝐨𝐮𝐫𝐜𝐞𝐬 𝐟𝐫𝐨𝐦 𝐈𝐧𝐝𝐢𝐚 (primarily) 𝐚𝐧𝐝 𝐋𝐀𝐓𝐀𝐌 𝐜𝐨𝐮𝐧𝐭𝐫𝐢𝐞𝐬 (secondary) 𝐑𝐞𝐬𝐩𝐨𝐧𝐬𝐢𝐛𝐢𝐥𝐢𝐭𝐢𝐞𝐬: • Design and implement the Agentic RAG architecture for large-scale data standardization. • Build scalable ETL pipelines using PySpark and Databricks for processing 1.2B+ records. • Design, develop, and optimize...

GCP Data Engineer (Contract | Remote) Location: Remote (India or LATAM preferred) Contract: 6–12 months (extension likely) Start: ASAP Overview We are supporting a large, enterprise-scale organization undergoing a significant modernization of its data and analytics platform. As part of this initiative, we are seeking an experienced GCP Data Engineer to help design, build, and scale...

NEOGOV , an HRIS Product company based in Los Angeles is the market and technology leader in human resources software for the public sector. Our HR suite empowers public sector HR to streamline processes in a centralized platform. We are looking for a Senior Data Engineer to join our data engineering team. The ideal candidate will be a hands-on technical expert with strong experience in...

Job Title: Senior / Lead Data Engineer – Healthcare Analytics (GCP) Experience: 8–10+ Years Location: Remote Time: 5:30 PM IST to 2:30 AM IST Domain: Healthcare Data & Analytics Primary Cloud: Google Cloud Platform (GCP) Job Summary We are seeking a highly experienced Senior / Lead Data Engineer with deep hands-on expertise in building scalable data platforms on Google Cloud Platform...