Title: Senior Data engineer - (Python, Kubernetes, DataLake & Kafka infrastructure)
Bangalore, Karnataka, IN, 560071
Job Summary
As a Senior Data engineer of the Active IQ Data Engineering at NetApp, you will play a crucial role in the development and maintenance of our data engineering and infrastructure. You will be responsible for designing and maintaining Data Infrastructure. You will be responsible for designing, building, and optimizing our data architecture, its infrastructure, as well as managing the flow of data throughout the organization. You will be part of a highly skilled technical team and working closely with the team of senior software developers and technical directors. You will be responsible for contributing and aligning to system level application architecture that includes high level design, coding standards, and development and testing of code. The software applications you build will be used by our internal sales team, partners, and customers.
This position requires an individual to be creative, team-oriented, technology savvy, driven to produce results and demonstrates the ability to work across teams.
Job Requirements
- You design, develop, and maintain our real time data processing, data LakeHouse infrastructure.
- You develop and maintain Ansible playbooks for infrastructure configuration and management
- You develop and maintain Kubernetes manifests, Helm charts, and other deployment artifacts
- You have hands on experience on Docker and containerisation and how to manage/prune the images in private registries.
- You have hands-on experience on access control in K8S cluster
- You monitor and troubleshoot issues related to Kubernetes clusters and containerized applications
- You drive initiatives to containerize standalone apps to be containerized in Kubernetes.
- You design, develop, and maintain our Kafka infrastructure, including topics, connectors, and brokers
- You develop and maintain infrastructure as code (IaC) and collaborate with other teams to ensure consistent infrastructure management across the organization
- You use observability tools to do “capacity management” of our services and infrastructure resources.
- You have a strong understanding of concepts related to computer architecture, data structures and programming practices
- You have a deep understanding of object-oriented programming and design
- You work on multiple tasks and responsibilities that will contribute towards team, program, and company goals
- Test Automation, Experience in AWS ECS and EKS is added advantage
Education
- 8 to 10 years of relevant experience.
- A Bachelor of Science Degree in Computer Science or master’s degree is required
Job Segment:
Testing, Data Architect, Computer Science, Engineer, Database, Technology, Data, Engineering