Big Data Developer jobs in Gautam Buddha Nagar

Purpose Design and develop scalable ETL pipelines, APIs, and automations for big data processing in an on-premise Hadoop/Spark/Airflow environment, focusing on real-time log enrichment and exposure via APIs for a visualization app. Take ownership of proposing and implementing solutions for data flow, performance, and integration challenges. Key Responsibilities - Architect and implement...

Required Skills: - 3 + Years Of an experience in Big Data Admin. - Should have hands-on Experience in Big Data Stack ,Apache Spark ,Azure Cloud: HDInsight, Fabric, ADF, Azure Compute, Storage, Networking Troubleshooting Skills

About Us HG Insights is the global leader in technology intelligence, delivering actionable AI driven insights through advanced data science and scalable big data solutions. What You’ll Do: - Design, build, and optimize large-scale distributed data pipelines for processing billions of unstructured documents using Databricks, Apache Spark, and cloud-native big data tools - Architect and scale...

We at Coforge are hiring for a detail-oriented Data Engineer (Apache Flume) to join our team. The ideal candidate will have 4+ years of hands-on experience in development, with strong expertise in Apache Flume, data modeling, and migration. This role involves leading the migration of existing logs from SQL Server databases to an Apache Flume application and establishing a robust pipeline for...

Blutic is looking for a Data Integration Developer (Level 2) with 4+ yrs experience in developing and maintaining ETL processes, reports, and database solutions using SSIS, SSRS, and SQL Server. This role requires solid technical skills to implement solutions, optimize code, and collaborate effectively in an Agile/Kanban environment under the guidance of senior team members. This is a 100% long...

• Building efficient storage for structured and unstructured data • Transform and aggregate the data using data processor technologies • Developing and deploying distributed computing Big Data applications using Open Source frameworks like Apache Spark, Apex, Flink, Nifi, and Kafka on AWS Cloud • Utilizing programming languages like Java, Scala, Python, and Open Source RDBMS and NoSQL databases...

BOLD is an established and fast-growing product company that transforms work lives. Since 2005, BOLD has delivered award-winning career services that have a meaningful and positive impact on job seekers and employers. BOLD’s robust product line includes a professional resume and cover letter writing services, scientifically validated career tests, and employer tools that help companies hire,...

JOB DETAILS •Owning the technical roadmap for evolving the data platform to support the future needs of the business •Providing thought leadership and mentoring to the data engineering team on how data should be stored and processed more efficiently and quickly at scale •Maintaining the big data platform and driving toward better SLA & cost optimization for the engineering and business...

Dreaming big is in our DNA. It’s who we are as a company. It’s our culture. It’s our heritage. And more than ever, it’s our future. A future where we’re always looking forward. Always serving up new ways to meet life’s moments. A future where we keep dreaming bigger. We look for people with passion, talent, and curiosity, and provide them with the teammates, resources and opportunities to unleash...

We are seeking for a Data Architect with over a decade of experience designing scalable data platforms and enterprise data models for pharma and life sciences organizations. This role requires strong knowledge of SQL/NoSQL databases, distributed systems, and cloud ecosystems across AWS, Azure, or GCP. The ideal candidate will build high-volume data pipelines, real-time streaming solutions, and...

Title – Senior Data Engineer Position – Contract with Opportunity for Full Time Conversion Location – Remote Work Salary – 1-2 Lakhs (Monthly) Working hours should be 6:30 am - 2:30 pm EST (USA) Qualifications - Bachelor’s or Master degree in Computer Science, Information Systems, or related field. - 6+ years experience architecting and building large scale data platforms - Experience...

Dreaming big is in our DNA. It’s who we are as a company. It’s our culture. It’s our heritage. And more than ever, it’s our future. A future where we’re always looking forward. Always serving up new ways to meet life’s moments. A future where we keep dreaming bigger. We look for people with passion, talent, and curiosity, and provide them with the teammates, resources and opportunities to unleash...

experience in administration of Hadoop Big Data tools • experience working on batch processing and tools in the Hadoop technical stack (e.g., MapReduce, Yarn, Hive, HDFS, Oozie) • The candidate must have experience in Ambari setup and management • 1 to 2 years of MapRcluster management/administration · • 2+ years of administration experience working with tools in the stream processing technical...

• Cloud Data Analytics (AWS, Oracle, Azure, Snowflake) – Hands-on solution design experience in at least two of cloud platforms. • Experience in growing & mining existing accounts • Experience in implementing at least 4 Cloud Data Analytics & Big Data engagements. • Extensive experience in solution design in complex projects in big data, cloud analytics, BI/DW, and data management. • Extensive...

• SQL Server 2014/16, Good SQL & ETL skills • Big data skills – Any skills like ADF, Databricks, Spark, Scala,.. • Ability to make business conclusions from data, connect scenarios & provide solutions • Prior experience in Microsoft landscape is preferred. • Good knowledge of SSIS (Not mandatory if the candidate has SQL & Big Data skills) • Working knowledge of PowerBI – Not mandatory • Strong...

Candidate should have: • Experience designing, developing, and testing applications using proven or emerging technologies, in a variety of technologies and environments. • Experience in using and tuning relational databases (Azure SQL Datawarehouse and SQL DB, MS SQL Server, or other RDBMS is a plus). • Experience with Data Lake implementations and design patterns • Experience with Lambda and...

Candidate should be able to: • This solution enables our Data Scientists and Data Analysts to actively detect trends, patterns, and relationships in data sets. •engage in the enhancement and maintenance support of data movement solutions to meet client business objectives and will have an opportunity to work with a cross-disciplinary team. •Contribute to the data movement project enhancement and...

Candidate should have •Superior oral, and written communication skills, as well as the willingness to collaborate across teams of internal and external technical staff, business analysts, software support, and operations staff. •Ability to write abstracted, reusable code components •Hands-on experience in writing shell scripts, complex SQL queries, Hadoop commands, and Git •Minimum 5 years...

• As an individual contributor, design modules, apply creative problem-solving using tools and technologies. • As individual contributor code and test modules. • Interact and collaborate directly with software developers, product managers, and business analysts to ensure proper development and quality of service applications and products. • Ability to do development in an Agile environment. •...

• Experience with Hadoop and the HDFS Ecosystem • Strong Experience with Apache Spark, Storm, Kafka is a must. • Experience with Python, R, Pig, Hive, Kafka, Knox, Tomcat and Ambari • Experience with MongoDB • A minimum of 4 years working with HBase/Hive/MRV1/MRV2 is required. • Experience in integrating heterogeneous applications is required. • Experience working with the Systems Operation...