Big Data Engineer jobs in Malappuram District

About Us HG Insights is the global leader in technology intelligence, delivering actionable AI driven insights through advanced data science and scalable big data solutions. What You’ll Do: - Design, build, and optimize large-scale distributed data pipelines for processing billions of unstructured documents using Databricks, Apache Spark, and cloud-native big data tools - Architect and scale...

Purpose Design and develop scalable ETL pipelines, APIs, and automations for big data processing in an on-premise Hadoop/Spark/Airflow environment, focusing on real-time log enrichment and exposure via APIs for a visualization app. Take ownership of proposing and implementing solutions for data flow, performance, and integration challenges. Key Responsibilities - Architect and implement...

Required Skills: - 3 + Years Of an experience in Big Data Admin. - Should have hands-on Experience in Big Data Stack ,Apache Spark ,Azure Cloud: HDInsight, Fabric, ADF, Azure Compute, Storage, Networking Troubleshooting Skills

We are seeking a skilled and innovative Data Science Engineer to join our dynamic team. You will be responsible for designing, developing, and deploying scalable data science solutions to address real-world problems. The ideal candidate is experienced in building end-to-end machine learning pipelines, integrating data science solutions into production systems, and working collaboratively with...

For an international project in Chennai, we are urgently looking for a Full Remote iGRAFX Data Engineer with +8 years of IT experience. We are looking for a motivated contractor. Candidates need to be fluent in English. Tasks and responsibilities: - Create and evolve Process Explorer-style views using iGrafx’s Path Stepper (to visualize happy paths/exceptions), QuickMap (to rapidly structure...

About Us We are Health Catalyst, a leading provider of data and analytics technology and services to healthcare organizations. Our mission is to be the catalyst for massive, measurable, data-informed healthcare improvement. We partner with health systems, hospitals, and other healthcare entities to help them use data to make smarter decisions, improve clinical outcomes, reduce costs, and enhance...

Job Summary We are seeking a skilled and detail-oriented Data Security Professional to strengthen our organization’s data protection and access control posture across cloud, SaaS, endpoint and network environments. This role focuses on implementing and operating data security controls, enforcing Zero Trust access, preventing data loss and ensuring secure usage of enterprise applications and...

About the Role Join our growing team to help build and optimize the data pipelines that power our analytics and machine learning models. This is a high-growth role with a strong focus on modern Data Warehousing, offering hands-on mentorship and structured training in Snowflake. Key Responsibilities - Pipeline Development: - Assist in building scalable ETL/ELT processes to move data into the...

NEOGOV , an HRIS Product company based in Los Angeles is the market and technology leader in human resources software for the public sector. Our HR suite empowers public sector HR to streamline processes in a centralized platform. We are looking for a Senior Data Engineer to join our data engineering team. The ideal candidate will be a hands-on technical expert with strong experience in...

******************************************************** Note - Need 7 years of relevant exp at Data Engineer - Education - B.E/B.Tech - Need only Chennai candidate - In-Person Interview ********************************************************* Job Summary: - Design and develop data pipelines using Azure Data Factory, Spark SQL, Pyspark, and Python Implement ETL/ELT processes for structured...

Coeo are trusted data management and analytics experts, delivering technology strategy and support for business. The team have deep technical and commercial experience working with Microsoft Data Services to help our clients optimize their costs and maximize the benefits from their investments in these technologies. Coeo has been established for over 17 years and has offices in Reading, UK and...

We are looking for a Lead GCP Big Data Engineer with strong expertise in building scalable data pipelines, ETL/ELT workflows, and big data solutions on Google Cloud Platform. This role combines technical leadership with hands-on development, driving best practices across data engineering initiatives and mentoring team members. Key Responsibilities:- - Design, develop, and maintain robust...

About Albertsons Companies Inc.: As a leading food and drug retailer in the United States, Albertsons Companies, Inc. operates over 2,200 stores across 35 states and the District of Columbia. Our well-known banners across the United States, including Albertsons, Safeway, Vons, Jewel-Osco and others, serve more than 36 million U.S customers each week. We build and shape technology solutions that...

About the Team The Data Platform Tech Team at Navi is instrumental in enabling data-driven decision-making across the organization. We build and manage the core infrastructure and tools required to collect, store, process, and analyze data at scale. We operate one of the most robust data platforms in Indian fintech — managing over 10 petabytes of data across 25,000+ tables. Our systems ensure...

Job Summary: We are seeking a skilled Data Quality Engineer to ensure the accuracy, reliability, and integrity of our data pipelines and workflows. The ideal candidate will have hands-on experience in data engineering concepts, with a strong focus on quality testing, validation, and pipeline orchestration. Key Responsibilities: Design, develop, and execute data quality test cases to validate...

Role: Azure data Engineer Relevant Experience: 5+ years only Location: Pan India (Remote) Notice Period: Immediate Joiners/15 days only If you're passionate about Azure and Data Engineering, this is your chance to be a part of something amazing! Apply Now: Send your updated resume to vaishnavi.r@method-hub.com Job Description: Primary Responsibilities - · Create and maintain data storage...

Job Overview: We are looking for a skilled and motivated Lead Data Engineer with strong experience in Python programming and Google Cloud Platform (GCP) to join our data engineering team. The ideal candidate will be responsible for requirements gathering, designing, architecting the solution, developing, and maintaining robust and scalable ETL (Extract, Transform, Load) & ELT data pipelines. The...

Company Description Texplorers Inc. is a leader in digital transformation for global enterprises, with over 15 years of experience in cloud technology and AI expertise. The company focuses on empowering businesses to scale efficiently and continuously improve through their innovation ecosystem. Texplorers Inc. is committed to innovation, sustainability, and inclusion, ensuring perpetual learning...

Position: Pyspark Data Engineer Experience: 5+ yrs hands on experience Location: Bangalore,Pune,Chennai,Gurugram Notice Period-0 to 30 Days Required Technical skill-Pyspark, python , Data, Spark Mode of Interview: Weekend Virtual Mode Date of Interview: 24-Jan-2026(Saturday) Roles & Responsibilities: - Good work experience on Big Data Platforms like Hadoop, Spark, Scala, Hive, Impala,...

For an international project in Chennai, we are urgently looking for a Full Remote Senior Azure Data Engineer, who will build data pipeline for enterprise search applications using ADF and Databricks. We are looking for a motivated contractor. Candidates need tbe fluent in English. Tasks and responsibilities: - Build data integration feeds according to the requirement; - Review the business...