Spark Developer jobs in Kollam District

Dear Candidate, Greetings from TATA Consultancy Services!! Thank you for expressing your interest in exploring a career possibility with the TCS Family. Hiring For:- Big Data with Pyspark/Spark, Scala Location: Mumbai - Olympus Experience: 5+years Required Technical Skill Set Pyspark, Hive, Hbase Must-Have Spark, Pyspark, Hive, Hbase, Kafka Good-to-Have Agile SN Responsibility of /...

- Core Frameworks: Apache Spark, PySpark, Airflow, NiFi, Kafka, Hive, Iceberg, Oozie - Programming Languages: Python, Scala, Java - Data Formats & Storage: Parquet, ORC, Avro, S3, HDFS - Orchestration & Workflow: Airflow, DBT - Performance Optimization: Spark tuning, partitioning strategies, caching, YARN/K8s resource tuning - Testing & Validation: Great Expectations, Deequ, SQL-based QA...

Job Title: Apprentice Leader – Data Engineering Experience: 4–7 years Location: Bangalore (Onsite) Employment Type: Full-Time Overview Our client – one of the largest data science companies – is seeking to hire a Data Engineer (Data Platform & DevOps) to design, build, and operate scalable data and ML platforms on AWS, Azure, or GCP. This role blends strong data engineering fundamentals with...

About the Role Out client is looking for a Senior Data Engineer / AI Engineer with strong expertise in large-scale data processing, real-time streaming systems, geospatial analytics, and AI/ML integration. The role involves building high-performance, scalable systems that process multimodal data including satellite imagery, CCTV feeds, and large enterprise datasets. You will work closely with...

Machine Learning Scientist (MLS-2) – Ranking & Personalization Role Description As a Machine Learning Scientist (MLS-2) in Nykaa’s Search team, you will focus on the core of our discovery engine: relevance and ranking. Your mission is to ensure that every search query—from "red lipstick" to "summer skincare"—surfaces the most relevant, personalized, and high-converting products. You will build...

Overall professional experience of the candidate should be atleast 8 years with a maximum experience upto 14 years. The candidate must understand the usage of data Engineering tools for solving business problems and help clients in their data journey. Must have knowledge of emerging technologies used in companies for data management including data governance, data quality, security, data...

We are looking for a Data Engineering Manager – Pharma to help pharmaceutical clients solve complex data and analytics challenges and enable sustained analytics transformation. You will work closely with global pharma stakeholders to understand their strategic, clinical, commercial, and operational goals and translate them into scalable, compliant data engineering solutions. This role requires a...

Pay: 810,748.90 (INR) – 3,276,721.89 (INR) per year Job Title: AI Engineer (Machine Learning & Deployment) - Opportunity to permanently relocate to Australia Location: Remote | Australia | India (Global Team) | Hybrid working anywhere in India Employment Type: Full-time / Contract Experience Level: 2-10 Years About the Role As an AI Engineer, you won't just be building models in a vacuum;...

Purpose Design and develop scalable ETL pipelines, APIs, and automations for big data processing in an on-premise Hadoop/Spark/Airflow environment, focusing on real-time log enrichment and exposure via APIs for a visualization app. Take ownership of proposing and implementing solutions for data flow, performance, and integration challenges. Key Responsibilities - Architect and implement...

Sikich India is seeking an experienced Data Engineer to join our Data & AI practice. You will design, build, and optimize end-to-end data solutions using Microsoft’s data platforms, including Microsoft Fabric, Azure Synapse Analytics, Databricks, and Power BI. Your work will involve implementing contemporary data architecture patterns (e.g., medallion, DataMesh, Zone-Based, or Lambda, etc...),...

Job SUMMARY: The Lead Data Modeler is responsible for the development of high performance, scalable enterprise data models on cloud platform. Should possess strong SQL skills with excellent data modelling skills. Needs to be well versed in the Kimball methodology. Should participate in various activities throughout the systems development lifecycle. Participate in support activities, involve in...

Flexton Inc., established in 2007, headquarter is in San Jose, CA with development centers in India at multiple locations. We are a leading professional services company offering a unique product mix that extends into Technology, Consulting, Digital and Operations. Job Title: Data Engineer Below is the complete job description Data Engineer Bangalore, India Hybrid We are seeking a Data...

About Servify: Servify is a global product lifecycle management company, operating across 3 continents (in India, North America, Europe and MENA), that focuses on designing as well as administering custom product protection programs and exchange/upgrade programs for carriers, OEM brands, and retailers. We have cultivated a diverse, global client portfolio that includes global fortune 100...

About the job Job Description Hiring: Data Engineer | Remote | Full-Time | Immediate Joiner Company: Natlov Technologies Pvt. Ltd Experience: 4 years CTC: APCS Natlov Technologies Pvt. Ltd is looking for a Data Engineer with strong AWS expertise and working experience in Azure. In this role, you will design, build, and optimize scalable data pipelines across multi-cloud environments using...

Senior Data Engineer (Azure / Microsoft Technologies) Location: India (Remote, Full-Time) Experience: 7+ Years (Strong Hands-On, Production-Grade) Role Overview - Design, build, and operate modern, cloud-native data platforms on Microsoft Azure. - Own end-to-end data pipelines with focus on scalability, security, governance, and performance. Key Responsibilities - Design cloud-native,...

About Position: We are looking for an experienced and talented GenAI Developer to join our growing data competency team. The ideal candidate will have a strong background working with GEN AI , ML ,LangChain, LangGraph, GenAI Architecture Strategy, Prompt engineering. You will work closely with our data analysts, engineers, and business teams to ensure optimal performance, scalability, and...

TCS is Hiring For GCP Data Engineer - BigQuery Experience: 5 YRS- 10YRS Location: CHENNAI, BANGALORE, HYDERABHAD Role : Data Engineer Skill :Big Data, Spark, HDFS, Kafka, Scala, AWS, Azure, GCP, ETL, Hadoop, Hive etc. JOB DESCRIPTION : Must-Have** • Strong experience in programming languages such as Python, Java, or Scala for data manipulation and engineering tasks. • Expertise in SQL and...

Machine Learning Scientist (MLS-3) – CLTV & Retention Role Description As a Machine Learning Scientist (MLS-3) in Nykaa’s Search & Personalization team, you will take end-to-end ownership of the algorithms that drive customer retention and long-term platform growth. You will be responsible for architecting and leading the development of sophisticated predictive models for Customer Lifetime...

Key Responsibilities: Leadership and Team Management: - Lead, mentor, and develop a team of data scientists. - Foster a culture of innovation, collaboration, and continuous learning. - Set clear goals and performance expectations for the team. Strategy and Vision: - Define and implement the data science strategy aligned with the company’s objectives. - Identify and prioritize data science...

We are seeking for a Data Architect with over a decade of experience designing scalable data platforms and enterprise data models for pharma and life sciences organizations. This role requires strong knowledge of SQL/NoSQL databases, distributed systems, and cloud ecosystems across AWS, Azure, or GCP. The ideal candidate will build high-volume data pipelines, real-time streaming solutions, and...