NVidia AVG Stack Consultant

Key Responsibilities

• Deploy and operate NVIDIA NIM microservices (including OCR, vision, and LLM NIMs) on appropriately sized GPU configurations, selecting the right GPU type, count, and memory profile for each workload.
• Right-size and tune GPU configs (GPU model, MIG partitioning, MPS, batch size, concurrency) to balance throughput, latency, and cost for production inference.
• Build and orchestrate data engineering pipelines for OCR - document ingestion, preprocessing, layout/text extraction, and post-processing of extracted content.
• Integrate NIM inference endpoints into pipelines for OCR, document understanding, embeddings, and downstream inferencing.
• Maximize GPU utilization and pipeline throughput using dynamic/continuous batching, async request handling, and parallel processing across documents/pages.
• Deploy and scale NIM containers on Kubernetes using the NVIDIA GPU Operator, device plugins, and autoscaling for variable inference demand.
• Monitor and profile GPU and pipeline performance (utilization, latency, queue depth, memory) using DCGM, nvidia-smi, and observability tooling; troubleshoot bottlenecks.
• Build robust, fault-tolerant data pipelines using orchestration tools (Airflow, ADF, or similar) with retries, checkpointing, and back-pressure handling.
• Manage NIM model artifacts via the Ncatalog, configure model profiles, and apply optimized engines (TensorRT) shipped within NIM.
• Collaborate with data and platform teams to productionize, version, and operate inference services with CI/CD.