Spark Developer jobs in Mangalore

Job TitleFull Stack Data EngineerJob Description● Programming: Python, SQL, Shell scripting.● GCP Data Stack:○ Data Storage: BigQuery, Cloud Storage○ Data Processing: Dataflow (Apache Beam), Dataproc (Spark), Cloud Composer (Airflow) ○ Streaming: Pub/Sub○ Orchestration: Cloud Composer / Airflow○ APIs & Services: Cloud Run, Cloud Functions, API Gateway○ Monitoring: Cloud Logging, Cloud Monitoring,...

For an international project in Chennai, we are urgently looking for a Full Remote Senior Azure Data Engineer, who will build data pipeline for enterprise search applications using ADF and Databricks. We are looking for a motivated contractor. Candidates need tbe fluent in English. Tasks and responsibilities: - Build data integration feeds according to the requirement; - Review the business...

Senior Data Engineer Location: Remote Company: Emeritus About Emeritus At Emeritus, we're committed to teaching you the skills of the future by making high-quality education accessible and affordable. We achieve this by collaborating with more than 80 top-tier universities across the United States, Europe, Latin America, Southeast Asia, India, and China. Our short courses, degree programs,...

About the Team The Data Platform Tech Team at Navi is instrumental in enabling data-driven decision-making across the organization. We build and manage the core infrastructure and tools required to collect, store, process, and analyze data at scale. We operate one of the most robust data platforms in Indian fintech — managing over 10 petabytes of data across 25,000+ tables. Our systems ensure...

Platform Engineer – Python / Databricks / Notebooks/ Kubernetes Job Description Syntasa is seeking a high-caliber and dedicated Platform Engineer to join its India subsidiary, Syntasa Technologies India Private Limited. This position offers an exciting opportunity to contribute to the growth of a world-class development and support center. The India operations will serve as an extension of...

Ready to be pushed beyond what you think you’re capable of? At Coinbase, our mission is to increase economic freedom in the world. It’s a massive, ambitious opportunity that demands the best of us, every day, as we build the emerging onchain platform — and with it, the future global financial system. To achieve our mission, we’re seeking a very specific candidate. We want someone who is...

We are seeking a skilled and innovative Data Science Engineer to join our dynamic team. You will be responsible for designing, developing, and deploying scalable data science solutions to address real-world problems. The ideal candidate is experienced in building end-to-end machine learning pipelines, integrating data science solutions into production systems, and working collaboratively with...

We are looking for a Lead GCP Big Data Engineer with strong expertise in building scalable data pipelines, ETL/ELT workflows, and big data solutions on Google Cloud Platform. This role combines technical leadership with hands-on development, driving best practices across data engineering initiatives and mentoring team members. Key Responsibilities:- - Design, develop, and maintain robust...

About the Company: Everest DX – We are a Digital Platform Services company, headquartered in Stamford. Our Platform/Solution includes Orchestration, Intelligent operations with BOTs’, AI-powered analytics for Enterprise IT. Our vision is to enable Digital Transformation for enterprises to deliver seamless customer experience, business efficiency and actionable insights through an integrated set...

Job Overview: We are looking for a skilled and motivated Lead Data Engineer with strong experience in Python programming and Google Cloud Platform (GCP) to join our data engineering team. The ideal candidate will be responsible for requirements gathering, designing, architecting the solution, developing, and maintaining robust and scalable ETL (Extract, Transform, Load) & ELT data pipelines. The...

Company Description Texplorers Inc. is a leader in digital transformation for global enterprises, with over 15 years of experience in cloud technology and AI expertise. The company focuses on empowering businesses to scale efficiently and continuously improve through their innovation ecosystem. Texplorers Inc. is committed to innovation, sustainability, and inclusion, ensuring perpetual learning...

About bluCognition: bluCognition is an AI/ML based start-up specializing in risk analytics, data conversion and data enrichment capabilities. Founded in 2017, by some very named senior professionals from the financial services industry, the company is headquartered in the US, with the delivery center based in Pune. We build all our solutions while leveraging the latest technology stack in AI, ML...

About AppleTech We are a CMMI 3 and an ISO 9001:2015 Certified web, mobile and software applications development company based in India. We are experts in development, customization and integration of complex enterprise-level solutions offering a well-balanced blend of technology skills, domain knowledge, hands-on experience, effective methodology, and passion for IT. We have extensive...

Purpose Design and develop scalable ETL pipelines, APIs, and automations for big data processing in an on-premise Hadoop/Spark/Airflow environment, focusing on real-time log enrichment and exposure via APIs for a visualization app. Take ownership of proposing and implementing solutions for data flow, performance, and integration challenges. Key Responsibilities - Architect and implement...

About Us HG Insights is the global leader in technology intelligence, delivering actionable AI driven insights through advanced data science and scalable big data solutions. What You’ll Do: - Design, build, and optimize large-scale distributed data pipelines for processing billions of unstructured documents using Databricks, Apache Spark, and cloud-native big data tools - Architect and scale...

Position: AWS Scala Data Engineer (4–10 Years Experience) Location: Hyderabad We are seeking a skilled Data Engineer to join our team, specializing in Scala, PySpark, and Databricks. In this position, you’ll work with complex data sets and a variety of data sources, ensuring the highest standards of data quality through robust validation processes. Key Responsibilities: - Design, develop,...

Sikich India is seeking an experienced Data Engineer to join our Data & AI practice. You will design, build, and optimize end-to-end data solutions using Microsoft’s data platforms, including Microsoft Fabric, Azure Synapse Analytics, Databricks, and Power BI. Your work will involve implementing contemporary data architecture patterns (e.g., medallion, DataMesh, Zone-Based, or Lambda, etc...),...

We are seeking for a Data Architect with over a decade of experience designing scalable data platforms and enterprise data models for pharma and life sciences organizations. This role requires strong knowledge of SQL/NoSQL databases, distributed systems, and cloud ecosystems across AWS, Azure, or GCP. The ideal candidate will build high-volume data pipelines, real-time streaming solutions, and...

Client is a VC-backed, cloud-native B2B platform transforming how hotels connect with global demand. Founded by serial travel-tech entrepreneurs and backed by Highgate Technology Ventures (HTV), we’re building the next generation of hotel distribution—automated, scalable, and integrated directly with CRS/PMS systems. Scale that speaks for itself: • 1B+ search requests per day • 40ms average...

Ready to be pushed beyond what you think you’re capable of? At Coinbase, our mission is to increase economic freedom in the world. It’s a massive, ambitious opportunity that demands the best of us, every day, as we build the emerging onchain platform — and with it, the future global financial system. To achieve our mission, we’re seeking a very specific candidate. We want someone who is...