Resident Engineer
Role Summary
The Resident Incident Engineer is responsible for maintaining the availability,
performance, resilience, and operational readiness of DDN storage infrastructure
deployed within a customer / NVIDIA Cloud Partner (NCP) environment.
The role will initially support a mid-tier NCP deployment that is expected to grow into
one of the largest storage environments in the region. The engineer will act as a trusted
on-site technical resource, working closely with the customer’s infrastructure, platform,
Kubernetes, networking, security, and operations teams.
The role requires hands-on expertise across DDN storage platforms, EXAScaler/Lustre,
Linux, high-speed networking, data-centre infrastructure, Kubernetes, and the
Container Storage Interface (CSI). The engineer will provide proactive operational
support, incident response, problem management, capacity planning, performance
optimization, and technical coordination with DDN Support and Engineering.
Key Responsibilities
• Provide on-site operational ownership for DDN storage systems and associated
EXAScaler/Lustre environments.
• Monitor storage health, availability, capacity, performance, alerts, and system
trends.
• Respond to incidents, service requests, and operational events in accordance
with agreed severity and response targets.
• Lead technical triage, fault isolation, recovery, and root-cause analysis for
storage, file-system, Linux, networking, and integration issues.
• Coordinate with customer operations teams, DDN Support, Engineering,
hardware vendors, and other stakeholders during major incidents.
• Maintain and troubleshoot EXAScaler/Lustre file systems, metadata services,
storage targets, client connectivity, failover, and recovery procedures.
• Support Kubernetes environments that consume DDN storage, including cluster
integration, persistent volumes, storage classes, access modes, and workloadlevel storage troubleshooting.
• Configure, validate, and troubleshoot CSI drivers and related Kubernetes storage
components
Investigate issues across the Kubernetes-to-storage path, including pods, nodes,
kubelet, CSI controller and node plugins, APIs, mounts, permissions,
networking, and backend storage.
• Support NFS, parallel file-system, block, and other storage access protocols
where applicable.
• Perform planned maintenance, upgrades, expansions, migrations, hardware
replacements, and configuration changes using approved change-management
processes.
• Develop and maintain operational runbooks, standard operating procedures,
recovery procedures, escalation guides, and troubleshooting documentation.
• Conduct regular health checks, capacity reviews, performance assessments,
and operational-readiness reviews.
• Identify risks, recurring failure patterns, single points of failure, and opportunities
to improve reliability and automation.
• Validate backup, restore, replication, disaster-recovery, and business-continuity
procedures where applicable.
• Support capacity forecasting for storage, metadata, network, client, and datagrowth requirements.
• Assist with performance benchmarking, workload analysis, tuning, and servicelevel reporting.
• Maintain accurate configuration management, asset records, incident records,
problem records, and installed-base information.
• Participate in on-call, out-of-hours, or escalation coverage as required by the
customer environment.
• Provide technical briefings, knowledge transfer, and operational training to
customer teams.
• Contribute to implementation schedules, risk and mitigation plans, acceptance
testing, handover, and customer sign-off.
Required Qualifications and Experience
• Bachelor’s degree or equivalent experience in Computer Science, Engineering,
Information Technology, or a related discipline.
• At least 5 years of experience in infrastructure engineering, storage
administration, systems administration, data-centre operations, or a related
field.
• Hands-on experience supporting enterprise storage, HPC, AI, cloud, or highperformance computing environments.
• Strong Linux systems administration and troubleshooting skills.