Big Data Engineer jobs in Davangere

Purpose Design and develop scalable ETL pipelines, APIs, and automations for big data processing in an on-premise Hadoop/Spark/Airflow environment, focusing on real-time log enrichment and exposure via APIs for a visualization app. Take ownership of proposing and implementing solutions for data flow, performance, and integration challenges. Key Responsibilities - Architect and implement...

About Us HG Insights is the global leader in technology intelligence, delivering actionable AI driven insights through advanced data science and scalable big data solutions. What You'll Do: - Design, build, and optimize large-scale distributed data pipelines for processing billions of unstructured documents using Databricks, Apache Spark, and cloud-native big data tools - Architect and scale...

Dear Candidate, Greetings from TATA Consultancy Services!! Thank you for expressing your interest in exploring a career possibility with the TCS Family. Hiring For:- Big Data with Pyspark/Spark, Scala Location: Mumbai - Olympus Experience: 5+years Required Technical Skill Set Pyspark, Hive, Hbase Must-Have Spark, Pyspark, Hive, Hbase, Kafka Good-to-Have Agile SN Responsibility of /...

Required Skills: - 3 + Years Of an experience in Big Data Admin. - Should have hands-on Experience in Big Data Stack ,Apache Spark ,Azure Cloud: HDInsight, Fabric, ADF, Azure Compute, Storage, Networking Troubleshooting Skills

- Core Frameworks: Apache Spark, PySpark, Airflow, NiFi, Kafka, Hive, Iceberg, Oozie - Programming Languages: Python, Scala, Java - Data Formats & Storage: Parquet, ORC, Avro, S3, HDFS - Orchestration & Workflow: Airflow, DBT - Performance Optimization: Spark tuning, partitioning strategies, caching, YARN/K8s resource tuning - Testing & Validation: Great Expectations, Deequ, SQL-based QA...

Pune/HYD "Primary Skills 6-8yrs of Experience in working as bigdata developer/supporting environemnts Strong knowledge in Unix/BigData Scripting Strong understanding of BigData (CDP/Hive) Environment Hands-on with GitHub and CI-CD implementations. Attitude to learn / understand ever task doing with reason Ability to work independently on specialized assignments within the context of...

About the job Job Description Hiring: Data Engineer | Remote | Full-Time | Immediate Joiner Company: Natlov Technologies Pvt. Ltd Experience: 4 years CTC: APCS Natlov Technologies Pvt. Ltd is looking for a Data Engineer with strong AWS expertise and working experience in Azure. In this role, you will design, build, and optimize scalable data pipelines across multi-cloud environments using...

About the Company: Tredence focuses on last-mile delivery of powerful insights into profitable actions by uniting its strengths in business analytics, data science and software engineering. The largest companies across industries are engaging with us and deploying their prediction and optimization solutions at scale. Head quartered in the San Francisco Bay Area, we serve clients in the US,...

We are Looking for Data Engineer exp : 5+years Location : Remote Notice Period : Immediate to 15 days (Serving Notice Period ) MANDATE - Snowflake, Python, Airflow, and SQL Key Responsibilities Design and develop data warehouse architectures and ETL/ELT pipelines. Build and orchestrate workflows using Python, SQL, Airflow, PySpark, Kafka, Databricks. Perform data modeling, validation, and...

We are looking for a Lead GCP Big Data Engineer with strong expertise in building scalable data pipelines, ETL/ELT workflows, and big data solutions on Google Cloud Platform. This role combines technical leadership with hands-on development, driving best practices across data engineering initiatives and mentoring team members. Key Responsibilities:- - Design, develop, and maintain robust...

Company Description Texplorers Inc. is a leader in digital transformation for global enterprises, with over 15 years of experience in cloud technology and AI expertise. The company focuses on empowering businesses to scale efficiently and continuously improve through their innovation ecosystem. Texplorers Inc. is committed to innovation, sustainability, and inclusion, ensuring perpetual learning...

About the Role We are seeking an experienced Data Engineer to design, build, and optimize scalable data architectures and pipelines that power business insights across our EdTech platform. The ideal candidate will bring strong expertise in data engineering, cloud data platforms, BI tools, and data governance, along with the ability to work cross-functionally to support data-driven...

Required Skills & Experience Bachelor’s degree (or equivalent experience) in Computer Science, Mathematics, Statistics, Physics, or a related quantitative field. Proficiency in Python and strong expertise in Scala (preferred) or Java. Hands-on experience with Big Data tools, especially Spark and familiarity with the Hadoop ecosystem. Proficiency in building ETL pipelines and working with AWS...

Role: Azure data Engineer 🔹 Relevant Experience: 5+ years only 🔹 Location: Pan India (Remote) 🔹 Notice Period: Immediate Joiners/15 days only If you’re passionate about Azure and Data Engineering, this is your chance to be a part of something amazing! 📧 Apply Now: Send your updated resume to vaishnavi.r@method-hub.com 📩 Job Description: Primary Responsibilities - · Create and maintain...

Title – Senior Data Engineer Position – Contract with Opportunity for Full Time Conversion Location – Remote Work Salary – 1-2 Lakhs (Monthly) Working hours should be 6:30 am - 2:30 pm EST (USA) Qualifications - Bachelor’s or Master degree in Computer Science, Information Systems, or related field. - 6+ years experience architecting and building large scale data platforms - Experience...

Job Title: Data Engineer (Data Warehouse Focus) Domain: BFSI Experience: 5-8 Years Location: Remote Employment Type: Full-Time Job Summary Seeking a Data Engineer with strong expertise in Snowflake, Python, Airflow, and SQL to design, build, and maintain scalable cloud-based data warehouse solutions for BFSI platforms. Key Responsibilities - Design and develop data warehouse architectures...

Job Title: Apprentice Leader – Data Engineering Experience: 4–7 years Location: Bangalore (Onsite) Employment Type: Full-Time Overview Our client – one of the largest data science companies – is seeking to hire a Data Engineer (Data Platform & DevOps) to design, build, and operate scalable data and ML platforms on AWS, Azure, or GCP. This role blends strong data engineering fundamentals with...

Job Title: Data Engineer Location: Hyderabad, Telangana Employment Type: Full-time | On-site / Hybrid About the Role We are looking for a skilled and detail-oriented Data Engineer to design, build, and maintain scalable data pipelines and architectures that power analytics, reporting, and machine learning across the organization. You will play a key role in ensuring reliable, high-quality...

Greetings from TCS! Job Title: Big Data with Pyspark/Spark, Scala Walkin Interview Date: 24th Jan ‘26 Walkin Location: TCS Siruseri, Siruseri SEZ Unit”, Plot No.1/G1, SIPCOT I. T Park, ATL Siruseri, Navalur Walkin Time: 9am-1pm Experience Range: 5+ yrs Job description: TCS has always been in the spotlight for being adept in the next big technologies. What we can offer you is a space to...

TCS is Hiring For GCP Data Engineer - BigQuery Experience: 5 YRS- 10YRS Location: CHENNAI, BANGALORE, HYDERABHAD Role : Data Engineer Skill :Big Data, Spark, HDFS, Kafka, Scala, AWS, Azure, GCP, ETL, Hadoop, Hive etc. JOB DESCRIPTION : Must-Have** • Strong experience in programming languages such as Python, Java, or Scala for data manipulation and engineering tasks. • Expertise in SQL and...