Big Data Developer jobs in Bijapur District, Karnataka

- Core Frameworks: Apache Spark, PySpark, Airflow, NiFi, Kafka, Hive, Iceberg, Oozie - Programming Languages: Python, Scala, Java - Data Formats & Storage: Parquet, ORC, Avro, S3, HDFS - Orchestration & Workflow: Airflow, DBT - Performance Optimization: Spark tuning, partitioning strategies, caching, YARN/K8s resource tuning - Testing & Validation: Great Expectations, Deequ, SQL-based QA...

Purpose Design and develop scalable ETL pipelines, APIs, and automations for big data processing in an on-premise Hadoop/Spark/Airflow environment, focusing on real-time log enrichment and exposure via APIs for a visualization app. Take ownership of proposing and implementing solutions for data flow, performance, and integration challenges. Key Responsibilities - Architect and implement...

Dear Candidate, Greetings from TATA Consultancy Services!! Thank you for expressing your interest in exploring a career possibility with the TCS Family. Hiring For:- Big Data with Pyspark/Spark, Scala Location: Mumbai - Olympus Experience: 5+years Required Technical Skill Set Pyspark, Hive, Hbase Must-Have Spark, Pyspark, Hive, Hbase, Kafka Good-to-Have Agile SN Responsibility of /...

Required Skills: - 3 + Years Of an experience in Big Data Admin. - Should have hands-on Experience in Big Data Stack ,Apache Spark ,Azure Cloud: HDInsight, Fabric, ADF, Azure Compute, Storage, Networking Troubleshooting Skills

Blutic is looking for a Data Integration Developer (Level 2) with 4+ yrs experience in developing and maintaining ETL processes, reports, and database solutions using SSIS, SSRS, and SQL Server. This role requires solid technical skills to implement solutions, optimize code, and collaborate effectively in an Agile/Kanban environment under the guidance of senior team members. This is a 100% long...

About Us HG Insights is the global leader in technology intelligence, delivering actionable AI driven insights through advanced data science and scalable big data solutions. What You’ll Do: - Design, build, and optimize large-scale distributed data pipelines for processing billions of unstructured documents using Databricks, Apache Spark, and cloud-native big data tools - Architect and scale...

About the job Job Description Hiring: Data Engineer | Remote | Full-Time | Immediate Joiner Company: Natlov Technologies Pvt. Ltd Experience: 4 years CTC: APCS Natlov Technologies Pvt. Ltd is looking for a Data Engineer with strong AWS expertise and working experience in Azure. In this role, you will design, build, and optimize scalable data pipelines across multi-cloud environments using...

We are Looking for Data Engineer exp : 5+years Location : Remote Notice Period : Immediate to 15 days (Serving Notice Period ) MANDATE - Snowflake, Python, Airflow, and SQL Key Responsibilities Design and develop data warehouse architectures and ETL/ELT pipelines. Build and orchestrate workflows using Python, SQL, Airflow, PySpark, Kafka, Databricks. Perform data modeling, validation, and...

Job Title: Data Engineer Location: Hyderabad, Telangana Employment Type: Full-time | On-site / Hybrid About the Role We are looking for a skilled and detail-oriented Data Engineer to design, build, and maintain scalable data pipelines and architectures that power analytics, reporting, and machine learning across the organization. You will play a key role in ensuring reliable, high-quality...

Company Description Texplorers Inc. is a leader in digital transformation for global enterprises, with over 15 years of experience in cloud technology and AI expertise. The company focuses on empowering businesses to scale efficiently and continuously improve through their innovation ecosystem. Texplorers Inc. is committed to innovation, sustainability, and inclusion, ensuring perpetual learning...

Title – Senior Data Engineer Position – Contract with Opportunity for Full Time Conversion Location – Remote Work Salary – 1-2 Lakhs (Monthly) Working hours should be 6:30 am - 2:30 pm EST (USA) Qualifications - Bachelor’s or Master degree in Computer Science, Information Systems, or related field. - 6+ years experience architecting and building large scale data platforms - Experience...

We are seeking a highly skilled and motivated Data Scientist to join our team. The ideal candidate will have a strong background in data analysis, deep learning, and GenAI. This role involves extracting meaningful insights from complex datasets and translating them into actionable strategies that drive business growth. You will collaborate with cross-functional teams to design and implement...

Job SUMMARY: The Lead Data Modeler is responsible for the development of high performance, scalable enterprise data models on cloud platform. Should possess strong SQL skills with excellent data modelling skills. Needs to be well versed in the Kimball methodology. Should participate in various activities throughout the systems development lifecycle. Participate in support activities, involve in...

Job Title: Apprentice Leader – Data Engineering Experience: 4–7 years Location: Bangalore (Onsite) Employment Type: Full-Time Overview Our client – one of the largest data science companies – is seeking to hire a Data Engineer (Data Platform & DevOps) to design, build, and operate scalable data and ML platforms on AWS, Azure, or GCP. This role blends strong data engineering fundamentals with...

About the Role We are seeking an experienced Data Engineer to design, build, and optimize scalable data architectures and pipelines that power business insights across our EdTech platform. The ideal candidate will bring strong expertise in data engineering, cloud data platforms, BI tools, and data governance, along with the ability to work cross-functionally to support data-driven...

We are looking for a Lead GCP Big Data Engineer with strong expertise in building scalable data pipelines, ETL/ELT workflows, and big data solutions on Google Cloud Platform. This role combines technical leadership with hands-on development, driving best practices across data engineering initiatives and mentoring team members. Key Responsibilities:- - Design, develop, and maintain robust...

Organization:- Leading Global Management Consulting Organization (One of the BIG 3) Role :- Data Engineering Sr Manager Location :- Gurugram Exp:- 10 + Years Skills :- 70% hands on technical + 30% People management What You'll Do As a Senior Manager - Data Engineering to spearhead our data engineering team that focuses on building and maintaining HR functional data products. This role...

Job Overview: We are looking for a skilled and motivated Lead Data Engineer with strong experience in Python programming and Google Cloud Platform (GCP) to join our data engineering team. The ideal candidate will be responsible for requirements gathering, designing, architecting the solution, developing, and maintaining robust and scalable ETL (Extract, Transform, Load) & ELT data pipelines. The...

We are seeking for a Data Architect with over a decade of experience designing scalable data platforms and enterprise data models for pharma and life sciences organizations. This role requires strong knowledge of SQL/NoSQL databases, distributed systems, and cloud ecosystems across AWS, Azure, or GCP. The ideal candidate will build high-volume data pipelines, real-time streaming solutions, and...

Greetings from TCS! Job Title: Big Data with Pyspark/Spark, Scala Walkin Interview Date: 24th Jan ‘26 Walkin Location: TCS Siruseri, Siruseri SEZ Unit”, Plot No.1/G1, SIPCOT I. T Park, ATL Siruseri, Navalur Walkin Time: 9am-1pm Experience Range: 5+ yrs Job description: TCS has always been in the spotlight for being adept in the next big technologies. What we can offer you is a space to...