Title:  Mts Software Engineer

Job Summary

As a Data Lake Engineer at NetApp India’s R&D division, you will be responsible for the design, development, and support of multi petabytes scale Datalakes for both on-prem and soon to be cloud environments. You will be part of a highly skilled technical team named NetApp Active IQ. 

The Active IQ DataHub platform processes over 10 trillion data points per month that feeds a multi-Petabyte DataLake. The platform is built using Kafka, a serverless platform running on Kubernetes, Spark and various NoSQL databases. This platform enables the use of advanced AI and ML techniques to uncover opportunities to proactively protect and optimize NetApp storage, and then provides the insights and actions to make it happen. We call this “actionable intelligence”

 You will be working closely with a team of Architect, Product Management, and a Technical Director. You will be responsible for contributing to the architecture, design, and development and testing of the Data Lake Solution. The Data Lake Solution you will be responsible for will be used by our internal product teams and other internal NetApp organizations.

We are looking for a Data Lake Engineer who is familiar with Cloud data platforms (preferably datalake), Data Modeling and Python.

Job Requirements

• Develop Modules to implement multiple petabytes scale datalake
• Be the first line of defence in case of any issue in datalake.
• Develop best practice sample deployments for use cases (to guide end users).
• Assist users in developing their own queries/jobs to address their use case.

Skillsets required

• Self-motivated
• Hands-on experience working on Cloud data platforms (preferably datalake)
• Hands-on coding experience (preferably python)
• Understanding of SQL & No-SQL Systems
• Strong data analysis & analytical problem-solving skills
• Ability to work successfully in a global team environment.
• Good to Have:  Experience with Atlassian toolkits (Jira, Bitbucket etc).