Big Data Engineer jobs in Varanasi District

Purpose Design and develop scalable ETL pipelines, APIs, and automations for big data processing in an on-premise Hadoop/Spark/Airflow environment, focusing on real-time log enrichment and exposure via APIs for a visualization app. Take ownership of proposing and implementing solutions for data flow, performance, and integration challenges. Key Responsibilities - Architect and implement...

About Us HG Insights is the global leader in technology intelligence, delivering actionable AI driven insights through advanced data science and scalable big data solutions. What You'll Do: - Design, build, and optimize large-scale distributed data pipelines for processing billions of unstructured documents using Databricks, Apache Spark, and cloud-native big data tools - Architect and scale...

Required Skills: - 3 + Years Of an experience in Big Data Admin. - Should have hands-on Experience in Big Data Stack ,Apache Spark ,Azure Cloud: HDInsight, Fabric, ADF, Azure Compute, Storage, Networking Troubleshooting Skills

Greetings from TCS! Job Title: Big Data with Pyspark/Spark, Scala Walkin Interview Date: 24th Jan ‘26 Walkin Location: TCS Siruseri, Siruseri SEZ Unit”, Plot No.1/G1, SIPCOT I. T Park, ATL Siruseri, Navalur Walkin Time: 9am-1pm Experience Range: 5+ yrs Job description: TCS has always been in the spotlight for being adept in the next big technologies. What we can offer you is a space to...

- Core Frameworks: Apache Spark, PySpark, Airflow, NiFi, Kafka, Hive, Iceberg, Oozie - Programming Languages: Python, Scala, Java - Data Formats & Storage: Parquet, ORC, Avro, S3, HDFS - Orchestration & Workflow: Airflow, DBT - Performance Optimization: Spark tuning, partitioning strategies, caching, YARN/K8s resource tuning - Testing & Validation: Great Expectations, Deequ, SQL-based QA...

Pune/HYD "Primary Skills 6-8yrs of Experience in working as bigdata developer/supporting environemnts Strong knowledge in Unix/BigData Scripting Strong understanding of BigData (CDP/Hive) Environment Hands-on with GitHub and CI-CD implementations. Attitude to learn / understand ever task doing with reason Ability to work independently on specialized assignments within the context of...

About the job Job Description Hiring: Data Engineer | Remote | Full-Time | Immediate Joiner Company: Natlov Technologies Pvt. Ltd Experience: 4 years CTC: APCS Natlov Technologies Pvt. Ltd is looking for a Data Engineer with strong AWS expertise and working experience in Azure. In this role, you will design, build, and optimize scalable data pipelines across multi-cloud environments using...

Role: Azure data Engineer 🔹 Relevant Experience: 5+ years only 🔹 Location: Pan India (Remote) 🔹 Notice Period: Immediate Joiners/15 days only If you’re passionate about Azure and Data Engineering, this is your chance to be a part of something amazing! 📧 Apply Now: Send your updated resume to vaishnavi.r@method-hub.com 📩 Job Description: Primary Responsibilities - · Create and maintain...

Company Description Texplorers Inc. is a leader in digital transformation for global enterprises, with over 15 years of experience in cloud technology and AI expertise. The company focuses on empowering businesses to scale efficiently and continuously improve through their innovation ecosystem. Texplorers Inc. is committed to innovation, sustainability, and inclusion, ensuring perpetual learning...

Job Title: Data Engineer (Data Warehouse Focus) Domain: BFSI Experience: 5-8 Years Location: Remote Employment Type: Full-Time Job Summary Seeking a Data Engineer with strong expertise in Snowflake, Python, Airflow, and SQL to design, build, and maintain scalable cloud-based data warehouse solutions for BFSI platforms. Key Responsibilities - Design and develop data warehouse architectures...

About Albertsons Companies Inc.: As a leading food and drug retailer in the United States, Albertsons Companies, Inc. operates over 2,200 stores across 35 states and the District of Columbia. Our well-known banners across the United States, including Albertsons, Safeway, Vons, Jewel-Osco and others, serve more than 36 million U.S customers each week. We build and shape technology solutions that...

About the Role We are seeking an experienced Data Engineer to design, build, and optimize scalable data architectures and pipelines that power business insights across our EdTech platform. The ideal candidate will bring strong expertise in data engineering, cloud data platforms, BI tools, and data governance, along with the ability to work cross-functionally to support data-driven...

About the Company: Tredence focuses on last-mile delivery of powerful insights into profitable actions by uniting its strengths in business analytics, data science and software engineering. The largest companies across industries are engaging with us and deploying their prediction and optimization solutions at scale. Head quartered in the San Francisco Bay Area, we serve clients in the US,...

We are Looking for Data Engineer exp : 5+years Location : Remote Notice Period : Immediate to 15 days (Serving Notice Period ) MANDATE - Snowflake, Python, Airflow, and SQL Key Responsibilities Design and develop data warehouse architectures and ETL/ELT pipelines. Build and orchestrate workflows using Python, SQL, Airflow, PySpark, Kafka, Databricks. Perform data modeling, validation, and...

Job Overview: We are looking for a skilled and motivated Lead Data Engineer with strong experience in Python programming and Google Cloud Platform (GCP) to join our data engineering team. The ideal candidate will be responsible for requirements gathering, designing, architecting the solution, developing, and maintaining robust and scalable ETL (Extract, Transform, Load) & ELT data pipelines. The...

For an international project in Chennai, we are urgently looking for a Full Remote Senior Azure Data Engineer, who will build data pipeline for enterprise search applications using ADF and Databricks. We are looking for a motivated contractor. Candidates need tbe fluent in English. Tasks and responsibilities: - Build data integration feeds according to the requirement; - Review the business...

Job Title: Data Engineer Location: Hyderabad, Telangana Employment Type: Full-time | On-site / Hybrid About the Role We are looking for a skilled and detail-oriented Data Engineer to design, build, and maintain scalable data pipelines and architectures that power analytics, reporting, and machine learning across the organization. You will play a key role in ensuring reliable, high-quality...

About the Team The Data Platform Tech Team at Navi is instrumental in enabling data-driven decision-making across the organization. We build and manage the core infrastructure and tools required to collect, store, process, and analyze data at scale. We operate one of the most robust data platforms in Indian fintech — managing over 10 petabytes of data across 25,000+ tables. Our systems ensure...

Dear Candidate, Greetings from TATA Consultancy Services!! Thank you for expressing your interest in exploring a career possibility with the TCS Family. Hiring For:- Big Data with Pyspark/Spark, Scala Location: Mumbai - Olympus Experience: 5+years Required Technical Skill Set Pyspark, Hive, Hbase Must-Have Spark, Pyspark, Hive, Hbase, Kafka Good-to-Have Agile SN Responsibility of /...

TCS is Hiring For GCP Data Engineer - BigQuery Experience: 5 YRS- 10YRS Location: CHENNAI, BANGALORE, HYDERABHAD Role : Data Engineer Skill :Big Data, Spark, HDFS, Kafka, Scala, AWS, Azure, GCP, ETL, Hadoop, Hive etc. JOB DESCRIPTION : Must-Have** • Strong experience in programming languages such as Python, Java, or Scala for data manipulation and engineering tasks. • Expertise in SQL and...