Spark Developer jobs in Anantapur District

Dear Candidate, Greetings from TATA Consultancy Services!! Thank you for expressing your interest in exploring a career possibility with the TCS Family. Hiring For:- Big Data with Pyspark/Spark, Scala Location: Mumbai - Olympus Experience: 5+years Required Technical Skill Set Pyspark, Hive, Hbase Must-Have Spark, Pyspark, Hive, Hbase, Kafka Good-to-Have Agile SN Responsibility of /...

- Core Frameworks: Apache Spark, PySpark, Airflow, NiFi, Kafka, Hive, Iceberg, Oozie - Programming Languages: Python, Scala, Java - Data Formats & Storage: Parquet, ORC, Avro, S3, HDFS - Orchestration & Workflow: Airflow, DBT - Performance Optimization: Spark tuning, partitioning strategies, caching, YARN/K8s resource tuning - Testing & Validation: Great Expectations, Deequ, SQL-based QA...

Job SUMMARY: The Lead Data Modeler is responsible for the development of high performance, scalable enterprise data models on cloud platform. Should possess strong SQL skills with excellent data modelling skills. Needs to be well versed in the Kimball methodology. Should participate in various activities throughout the systems development lifecycle. Participate in support activities, involve in...

Founded in the year 2017, CoffeeBeans specialises in offering high end consulting services in technology, product, and processes. We help our clients attain significant improvement in quality of delivery through impactful product launches, process simplification, and help build competencies that drive business outcomes across industries. The company uses new-age technologies to help its clients...

Credit Risk Machine Learning Model Specialist Location: Gurgaon/Bangalore/Pune Department: Analytics & Risk Management Experience Level: 4+ years About the Role We are seeking a talented Credit Risk Machine Learning Model Specialist to join our dynamic team at EXL. In this role, you will develop and deploy advanced ML models to drive credit risk strategies across the consumer lending...

Machine Learning Scientist (MLS-2) – Ranking & Personalization Role Description As a Machine Learning Scientist (MLS-2) in Nykaa’s Search team, you will focus on the core of our discovery engine: relevance and ranking. Your mission is to ensure that every search query—from "red lipstick" to "summer skincare"—surfaces the most relevant, personalized, and high-converting products. You will build...

About Position: The Data Scientist position requires an experienced professional who is passionate about data modeling using machine learning and product development to help us build and maintain statistical & ML/AI based solutions in the AML & Sanctions, Compliance space, specifically supporting the Transaction Monitoring, Sanctions screening and Client Due Diligence programs. The candidate...

- Backend Engineer - Experience – 8-10 Years - Location – Chennai/Bangalore Building enterprise-grade AI-powered applications, enabling knowledge automation and conversational intelligence. You will collaborate closely with cross-functional teams, ensuring seamless CI/CD integration and DevOps best practices while driving innovation through modern AI/ML frameworks. Key Responsibilities •...

Sr. MTS Java Backend Engineer Product based background preferred only. What Will You Do? We are looking for exceptional Engineers, who take pride in creating simple solutions to apparently-complex problems. Our Engineering tasks typically involve at least one of the following: - Design, implement, and maintain the linking graph database that tracks relationships between all SEO-managed...

About AppleTech We are a CMMI 3 and an ISO 9001:2015 Certified web, mobile and software applications development company based in India. We are experts in development, customization and integration of complex enterprise-level solutions offering a well-balanced blend of technology skills, domain knowledge, hands-on experience, effective methodology, and passion for IT. We have extensive...

We are looking for a Lead GCP Big Data Engineer with strong expertise in building scalable data pipelines, ETL/ELT workflows, and big data solutions on Google Cloud Platform. This role combines technical leadership with hands-on development, driving best practices across data engineering initiatives and mentoring team members. Key Responsibilities:- - Design, develop, and maintain robust...

******************************************************** Note - Need 7 years of relevant exp at Data Engineer - Education - B.E/B.Tech - Need only Chennai candidate - In-Person Interview ********************************************************* Job Summary: - Design and develop data pipelines using Azure Data Factory, Spark SQL, Pyspark, and Python Implement ETL/ELT processes for structured...

Coeo are trusted data management and analytics experts, delivering technology strategy and support for business. The team have deep technical and commercial experience working with Microsoft Data Services to help our clients optimize their costs and maximize the benefits from their investments in these technologies. Coeo has been established for over 17 years and has offices in Reading, UK and...

Role Overview We are seeking a highly skilled Senior Databricks AI/ML Engineer to lead the design, development, and deployment of advanced analytics and machine learning solutions. The ideal candidate will bring deep expertise in Databricks, strong hands-on experience in both AI and traditional ML models, and advanced proficiency in SQL and Python. The engineer will work closely with...

Job Summary: We are seeking a skilled Data Quality Engineer to ensure the accuracy, reliability, and integrity of our data pipelines and workflows. The ideal candidate will have hands-on experience in data engineering concepts, with a strong focus on quality testing, validation, and pipeline orchestration. Key Responsibilities: Design, develop, and execute data quality test cases to validate...

Ready to be pushed beyond what you think you’re capable of? At Coinbase, our mission is to increase economic freedom in the world. It’s a massive, ambitious opportunity that demands the best of us, every day, as we build the emerging onchain platform — and with it, the future global financial system. To achieve our mission, we’re seeking a very specific candidate. We want someone who is...

Sikich India is seeking an experienced Data Engineer to join our Data & AI practice. You will design, build, and optimize end-to-end data solutions using Microsoft’s data platforms, including Microsoft Fabric, Azure Synapse Analytics, Databricks, and Power BI. Your work will involve implementing contemporary data architecture patterns (e.g., medallion, DataMesh, Zone-Based, or Lambda, etc...),...

Title – Senior Data Engineer Position – Contract with Opportunity for Full Time Conversion Location – Remote Work Salary – 1-2 Lakhs (Monthly) Working hours should be 6:30 am - 2:30 pm EST (USA) Qualifications - Bachelor’s or Master degree in Computer Science, Information Systems, or related field. - 6+ years experience architecting and building large scale data platforms - Experience...

For an international project in Chennai, we are urgently looking for a Full Remote Senior Azure Data Engineer, who will build data pipeline for enterprise search applications using ADF and Databricks. We are looking for a motivated contractor. Candidates need tbe fluent in English. Tasks and responsibilities: - Build data integration feeds according to the requirement; - Review the business...

Data Scientist Job Description Data Scientist — Machine Learning / Deep Learning (PyTorch or TensorFlow) Role summary We are seeking an experienced Data Scientist for Cyber Analytics & AI team to design, build, and deploy machine learning and deep learning solutions for client engagements. You’ll lead end-to-end model development: data preparation, model design with PyTorch or TensorFlow,...