Spark Developer jobs in West Bengal

Dear Candidate, Greetings from TATA Consultancy Services!! Thank you for expressing your interest in exploring a career possibility with the TCS Family. Hiring For:- Big Data with Pyspark/Spark, Scala Location: Mumbai - Olympus Experience: 5+years Required Technical Skill Set Pyspark, Hive, Hbase Must-Have Spark, Pyspark, Hive, Hbase, Kafka Good-to-Have Agile SN Responsibility of /...

- Core Frameworks: Apache Spark, PySpark, Airflow, NiFi, Kafka, Hive, Iceberg, Oozie - Programming Languages: Python, Scala, Java - Data Formats & Storage: Parquet, ORC, Avro, S3, HDFS - Orchestration & Workflow: Airflow, DBT - Performance Optimization: Spark tuning, partitioning strategies, caching, YARN/K8s resource tuning - Testing & Validation: Great Expectations, Deequ, SQL-based QA...

Candidates ready to join immediately can share their details via email for quick processing. 📌 CCTC | ECTC | Notice Period | Location Preference nitin.patil@ust.com Act fast for immediate attention! ⏳📩 Key Responsibilities - Design, develop, and maintain scalable data pipelines using PySpark - Build and manage batch and real-time data processing systems - Develop and integrate Kafka-based...

Key Responsibilities: 1. Data Analysis and Insights: ○ Analyze structured and unstructured data to uncover trends and patterns in debt collection and AR management. ○ Develop visualizations and dashboards to present key insights to stakeholders. 2. Model Development: ○ Build and optimize predictive models for debt repayment likelihood, customer segmentation, and credit risk assessment. ○...

Role 1: Pod Lead – Senior Data Engineer / Data Architect Experience: 5–6 Years Location - Bangalore Role Summary We are seeking a Senior Data Engineer / Data Architect to lead a Data Engineering pod and drive the design, development, and optimization of scalable data platforms on Azure Databricks. This role combines hands-on engineering, architecture ownership, and technical leadership,...

Job Description: Political Analyst Location: Chennai; for projects across India "Note: This is a short-term contractual role for a duration of 30th May 2026. Tamil and English language is a must have requirement for this role." About Varahe Analytics: Varahe Analytics is one of India’s premier integrated political consulting firms, specializing in building data-driven 360-degree election...

We are seeking an experienced Databricks Data Engineer with 5–8 years of industry experience. The ideal candidate will have a proven track record of working on live projects, preferably within the manufacturing or energy sectors. He/she will play a key role in developing, and maintaining scalable data solutions using Databricks and related technologies. Experience: 5+ years Work Location: Navi...

- Backend Engineer - Experience – 8-10 Years - Location – Chennai/Bangalore Building enterprise-grade AI-powered applications, enabling knowledge automation and conversational intelligence. You will collaborate closely with cross-functional teams, ensuring seamless CI/CD integration and DevOps best practices while driving innovation through modern AI/ML frameworks. Key Responsibilities •...

We are hiring AWS Lead Data Engineer for 3 Months contract Title- AWS Lead Data Engineer Experience -8+ years Location: Remote Contract Duration- 3 Months Requirements Bachelor’s or Master’s degree in Computer Science, Information Systems, Engineering, or a related discipline plus at least 8 years of hands-on data engineering experience, or demonstrated equivalency of experience and/or...

Job Title: Data Engineer Location: Hyderabad, Telangana Employment Type: Full-time | On-site / Hybrid About the Role We are looking for a skilled and detail-oriented Data Engineer to design, build, and maintain scalable data pipelines and architectures that power analytics, reporting, and machine learning across the organization. You will play a key role in ensuring reliable, high-quality...

What is it for you? As an Enterprise Architect, you will be a part of an Agile team to design and build healthcare applications and implement new features while adhering to the best coding development standards. Location: - Mumbai Pune Bangalore Chennai Experience : - 18 to 24 Years Responsibilities: - Design scalable, secure, and cost-effective cloud data platforms leveraging...

Job Overview: We are looking for a skilled and motivated Lead Data Engineer with strong experience in Python programming and Google Cloud Platform (GCP) to join our data engineering team. The ideal candidate will be responsible for requirements gathering, designing, architecting the solution, developing, and maintaining robust and scalable ETL (Extract, Transform, Load) & ELT data pipelines. The...

Position: AWS Scala Data Engineer (4–10 Years Experience) Location: Hyderabad We are seeking a skilled Data Engineer to join our team, specializing in Scala, PySpark, and Databricks. In this position, you’ll work with complex data sets and a variety of data sources, ensuring the highest standards of data quality through robust validation processes. Key Responsibilities: - Design, develop,...

We are seeking for a Data Architect with over a decade of experience designing scalable data platforms and enterprise data models for pharma and life sciences organizations. This role requires strong knowledge of SQL/NoSQL databases, distributed systems, and cloud ecosystems across AWS, Azure, or GCP. The ideal candidate will build high-volume data pipelines, real-time streaming solutions, and...

Purpose Design and develop scalable ETL pipelines, APIs, and automations for big data processing in an on-premise Hadoop/Spark/Airflow environment, focusing on real-time log enrichment and exposure via APIs for a visualization app. Take ownership of proposing and implementing solutions for data flow, performance, and integration challenges. Key Responsibilities - Architect and implement...

Salary: 40-50 lahks INR Position: AI Solutions Engineer – Loyalty Platform Group Overview We are looking for an experienced AI Solutions Engineer to join a global technology team responsible for building and operating large-scale loyalty platforms. This role focuses on leveraging Artificial Intelligence to optimize internal operations, improve productivity, and deliver innovative solutions for...

Job SUMMARY: The Lead Data Modeler is responsible for the development of high performance, scalable enterprise data models on cloud platform. Should possess strong SQL skills with excellent data modelling skills. Needs to be well versed in the Kimball methodology. Should participate in various activities throughout the systems development lifecycle. Participate in support activities, involve in...

About Inspire Brands: Inspire Brands is disrupting the restaurant industry through digital transformation and operational efficiencies. The company’s technology hub, Inspire Brands Hyderabad Support Center, India, will lead technology innovation and product development for the organization and its portfolio of distinct brands. The Inspire Brands Hyderabad Support Center will focus on developing...

Flexton Inc., established in 2007, headquarter is in San Jose, CA with development centers in India at multiple locations. We are a leading professional services company offering a unique product mix that extends into Technology, Consulting, Digital and Operations. Job Title: Data Engineer Below is the complete job description Data Engineer Bangalore, India Hybrid We are seeking a Data...

Greetings from TCS!!! Walk-in Interview for AWS Data Engineer at Kolkata Experience Required: 4 to 10 Years Location: Kolkata Job Description: 1. Expertise in PySpark, Python 2. Strong proficiency in AWS services: Glue, Redshift, S3, Lambda, EMR, Kinesis. 3. Hands-on experience with ETL tools and data pipeline orchestration. 4. Proficiency in Python or Scala for data processing. 5....