Spark Developer jobs in Chengalpattu

About UsHG Insights is the global leader in technology intelligence, delivering actionable AI driven insights through advanced data science and scalable big data solutions.What You’ll Do:Design, build, and optimize large-scale distributed data pipelines for processing billions of unstructured documents using Databricks, Apache Spark, and cloud-native big data toolsArchitect and scale...

PurposeDesign and develop scalable ETL pipelines, APIs, and automations for big data processing in an on-premise Hadoop/Spark/Airflow environment, focusing on real-time log enrichment and exposure via APIs for a visualization app. Take ownership of proposing and implementing solutions for data flow, performance, and integration challenges.Key ResponsibilitiesArchitect and implement ETL/ELT...

Job Summary:We are seeking a skilled Data Quality Engineer to ensure the accuracy, reliability, and integrity of our data pipelines and workflows. The ideal candidate will have hands-on experience in data engineering concepts, with a strong focus on quality testing, validation, and pipeline orchestration.Key Responsibilities:Design, develop, and execute data quality test cases to validate data...

About the RoleWe are seeking a Machine Learning Engineer to design, build, and deploy scalable ML models that power data-driven products and decisions. You will work closely with data scientists, software engineers, and product teams to take models from research to production in a fully remote environment.Key ResponsibilitiesDesign, develop, and deploy machine learning models for production...

About AppleTechWe are a CMMI 3 and an ISO 9001:2015 Certified web, mobile and software applications development company based in India. We are experts in development, customization and integration of complex enterprise-level solutions offering a well-balanced blend of technology skills, domain knowledge, hands-on experience, effective methodology, and passion for IT.We have extensive experience...

We are looking for a Lead GCP Big Data Engineer with strong expertise in building scalable data pipelines, ETL/ELT workflows, and big data solutions on Google Cloud Platform .This role combines technical leadership with hands-on development , driving best practices across data engineering initiatives and mentoring team members.Key Responsibilities:-Design, develop, and maintain robust ETL/ELT...

Company DescriptionTexplorers Inc. is a leader in digital transformation for global enterprises, with over 15 years of experience in cloud technology and AI expertise. The company focuses on empowering businesses to scale efficiently and continuously improve through their innovation ecosystem. Texplorers Inc. is committed to innovation, sustainability, and inclusion, ensuring perpetual learning...

About the Company:Everest DX – We are a Digital Platform Services company, headquartered in Stamford. Our Platform/Solution includes Orchestration, Intelligent operations with BOTs’, AI-powered analytics for Enterprise IT. Our vision is to enable Digital Transformation for enterprises to deliver seamless customer experience, business efficiency and actionable insights through an integrated set of...

Position: AWS Scala Data Engineer (4–10 Years Experience)Location: HyderabadWe are seeking a skilled Data Engineer to join our team, specializing in Scala, PySpark, and Databricks. In this position, you’ll work with complex data sets and a variety of data sources, ensuring the highest standards of data quality through robust validation processes.Key Responsibilities:Design, develop, and support...

We are seeking for a Data Architect with over a decade of experience designing scalable data platforms and enterprise data models for pharma and life sciences organizations. This role requires strong knowledge of SQL/NoSQL databases, distributed systems, and cloud ecosystems across AWS, Azure, or GCP. The ideal candidate will build high-volume data pipelines, real-time streaming solutions, and...

Data Engineer | Bengaluru | 1.5-3 yrs | Immediate joinersResponsibilities :•Understand data needs by interfacing with Data Analysts, Data Scientists, DataEngineers, and Business Partners•Architect, build and launch efficient & reliable new data models and pipelines inpartnership with Data Engineering•Design, define, and implement metrics and dimensions to enable analysis andpredictive...

Quality and Analytics Specialist About Us We do things differently. We build a solution for enterprises to make sense of all of their information. We know how important it is for companies to understand their customers, so we provide our technology to solve their biggest challenges. We believe in open and transparent communication, not strict rules and hierarchies. We are a team of hardworking,...

About the JobAs an AI/ML Engineer, you will be responsible for designing, validating, and integrating cutting-edge machine learning models and algorithms. Collaborate closely with cross-functional teams, including data scientists, to recognize and establish project objectives. Oversee data infrastructure maintenance, ensuring streamlined and scalable data operations. Stay updated with...

We are seeking a highly skilled and motivated Data Scientist to join our team. The ideal candidate will have a strong background in data analysis, deep learning, and GenAI. This role involves extracting meaningful insights from complex datasets and translating them into actionable strategies that drive business growth. You will collaborate with cross-functional teams to design and implement...

Ready to be pushed beyond what you think you’re capable of?At Coinbase, our mission is to increase economic freedom in the world. It’s a massive, ambitious opportunity that demands the best of us, every day, as we build the emerging onchain platform — and with it, the future global financial system.To achieve our mission, we’re seeking a very specific candidate. We want someone who is passionate...

Senior Data EngineerLocation: RemoteCompany: EmeritusAbout EmeritusAt Emeritus, we're committed to teaching you the skills of the future by makinghigh-quality education accessible and affordable. We achieve this by collaborating with more than 80 top-tier universities across the United States, Europe, Latin America, Southeast Asia, India, and China. Our short courses, degree programs,...

******************NoteNeed 7 years of relevant exp at Data EngineerEducation - B.E/B.TechNeed only Chennai candidateIn-Person Interview*******************Job Summary:Design and develop data pipelines using Azure Data Factory, Spark SQL, Pyspark, and Python Implement ETL/ELT processes for structured and unstructured data sources Optimize queries and data models in Azure Synapse Analytics and...

Ready to be pushed beyond what you think you’re capable of?At Coinbase, our mission is to increase economic freedom in the world. It’s a massive, ambitious opportunity that demands the best of us, every day, as we build the emerging onchain platform — and with it, the future global financial system.To achieve our mission, we’re seeking a very specific candidate. We want someone who is passionate...

Data Scientist Job DescriptionData Scientist — Machine Learning / Deep Learning (PyTorch or TensorFlow)Role summaryWe are seeking an experienced Data Scientist for Cyber Analytics & AI team to design, build, and deploy machine learning and deep learning solutions for client engagements. You’ll lead end-to-end model development: data preparation, model design with PyTorch or TensorFlow, scalable...

Client is a VC-backed, cloud-native B2B platform transforming how hotels connect with global demand. Founded by serial travel-tech entrepreneurs and backed by Highgate Technology Ventures (HTV) , we’re building the next generation of hotel distribution—automated, scalable, and integrated directly with CRS/PMS systems.Scale that speaks for itself:• 1B+ search requests per day• 40ms average...