Spark Developer jobs in Chennai District

As a Senior Data Engineer, you’ll be part of a team of smart, highly skilled technologists who are passionate about learning and prototyping cutting-edge technologies. Ingestion Services is working on unifying and standardizing several varied ingestion methodologies and convergence initiatives with latest Big Data services on Spark, Scala, Databricks, PySpark and leverage GitHub to support things...

Pyspark Technical Lead Experience: 5 to 10 years Location: Noida/ Chennai Define and implement the data requirements and database structure for the application. This includes viable solution building for large amount of data with state of the art technologies such as Spark for Big Data, NoSQL for databases and Python. Work with French customers directly and must have good proficiency in French...

Candidate should be able to: Understanding of different types of testing – Unit, Acceptance, Regression, Performance, etc. open to receiving feedback and constructive criticism. Proficiency working with large data stores understanding of Test Driven Development (TDD) or Pair Programming Candidate should have: Deep understanding of all aspects of database technologies - schema design,...

Description : We are seeking a Software/Application Dev Lead Analyst for Global Data Platform team. The successful candidate will interact with development, testing, and production support teams, as well as other departments within Citigroup (such as the System Administrators, Database Administrators, Data Centre Operations, and Change Control groups) for Services Data platforms. He/she...

Talent Worx is thrilled to announce an exciting opportunity for the roles of Snowflake and Spark Developers! Join us in revolutionizing the data analytics landscape as we partner with one of the Big 4 firms in India. What impact will you make? Your contributions will play a vital role in shaping our clients' success stories by utilizing innovative technologies and frameworks. Envision a dynamic...

Tech Lead- Java, Spark - CREQ192251 Description Required Skills: Proven experience as SPARK developer Strong programming skills in Java Familiarity with Big Data processing tools and techniques Experience with Hadoop ecosystem Good understanding of distributed system Experience with streaming data Understanding of standard SDLC and Agile processes Good experience in the coding standards and code...

Job Title: Data Engineer – Azure ADF Location: Brookfield, Bangalore Work Mode: Work from Office Experience: 5–6 Years Joining: Immediate Joiners Only Job Description Accion Labs is hiring an experienced Data Engineer with strong expertise in Azure Data Factory (ADF) to join our team in Bangalore. Key Responsibilities - Design, develop, and maintain data pipelines using Azure Data...

About Client: Our Client is a global IT services company headquartered in Southborough, Massachusetts, USA. Founded in 1996, with a revenue of $1.8B, with 35,000+ associates worldwide, specializes in digital engineering, and IT services company helping clients modernize their technology infrastructure, adopt cloud and AI solutions, and accelerate innovation. It partners with major firms in...

Key Responsibilities: Leadership and Team Management: - Lead, mentor, and develop a team of data scientists. - Foster a culture of innovation, collaboration, and continuous learning. - Set clear goals and performance expectations for the team. Strategy and Vision: - Define and implement the data science strategy aligned with the company’s objectives. - Identify and prioritize data science...

Position: AWS Scala Data Engineer (4–10 Years Experience) Location: Hyderabad We are seeking a skilled Data Engineer to join our team, specializing in Scala, PySpark, and Databricks. In this position, you’ll work with complex data sets and a variety of data sources, ensuring the highest standards of data quality through robust validation processes. Key Responsibilities: - Design, develop,...

Role: Cloudera Hadoop Admin Experience: 5+ yrs Location: Bangalore,Chennai,Hyderabad • Looking for Lead Platform Support Specialist with 6-8 years of Platform support Experience (Hadoop / Spark / Airflow) • Monitor and maintain platform performance across production and staging environments. • Troubleshoot and resolve technical issues related to platform functionality, integrations, and user...

Platform Engineer – Python / Databricks / Notebooks/ Kubernetes Job Description Syntasa is seeking a high-caliber and dedicated Platform Engineer to join its India subsidiary, Syntasa Technologies India Private Limited. This position offers an exciting opportunity to contribute to the growth of a world-class development and support center. The India operations will serve as an extension of...

Title – Senior Data Engineer Position – Contract with Opportunity for Full Time Conversion Location – Remote Work Salary – 1-2 Lakhs (Monthly) Working hours should be 6:30 am - 2:30 pm EST (USA) Qualifications - Bachelor’s or Master degree in Computer Science, Information Systems, or related field. - 6+ years experience architecting and building large scale data platforms - Experience...

Job Summary: We are seeking a skilled Data Quality Engineer to ensure the accuracy, reliability, and integrity of our data pipelines and workflows. The ideal candidate will have hands-on experience in data engineering concepts, with a strong focus on quality testing, validation, and pipeline orchestration. Key Responsibilities: Design, develop, and execute data quality test cases to validate...

About the Role: The Data Specialist evaluates learners’ technical proficiency in data engineering, analytics, and cloud data platforms. This role involves comprehensive assessment across SQL, data pipeline development, data modeling, and visualization capabilities, while providing actionable feedback to accelerate learner development. . The specialist collaborates closely with trainers and...

We are seeking a highly skilled and motivated Data Scientist to join our team. The ideal candidate will have a strong background in data analysis, deep learning, and GenAI. This role involves extracting meaningful insights from complex datasets and translating them into actionable strategies that drive business growth. You will collaborate with cross-functional teams to design and implement...

Candidate should be able to: Analyze, design, program, debug, and modify software enhancements and/or new products used in local, networked, or Internet-related computer programs, primarily for end-users Write code and complete programming by using current programming languages and technologies Interact with users to define system requirements and/or necessary modifications Complete...

Company Description: NIQ is the world’s leading consumer intelligence company, delivering the most complete understanding of consumer buying behavior and revealing new pathways to growth. In 2023, NIQ combined with GfK, bringing together the two industry leaders with unparalleled global reach. With a holistic retail read and the most comprehensive consumer insights—delivered with advanced...

• 10+ years experience in software development using Core Java and 5+ years experience in technologies (Hadoop, Spark, and Big Data platforms, RBDMS, NoSQL) • Advanced SQL capabilities are required. • Good Knowledge of database design techniques and experience working with huge data volumes is a plus. • Experience in Agile SDLC, JIRA, BitBucket/Git, AWS ECS, RedShift is a plus • Advanced...

Candidate should be able to: Coordinate Development, Integration, and Production deployments. Optimize Spark code, Impala queries, and Hive partitioning strategy for better scalability, reliability, and performance. Build applications using Maven, SBT and integrated with continuous integration servers like Jenkins to build jobs. Execute Hadoop ecosystem and Applications through Apache HUE Build...