
KubernetesMLOpsVector DatabasesSystem Design
We are seeking an AI Platform Engineer to build compute platforms, vector datastores, and infrastructure optimized for training and serving AI models.
Tech stack: Python, Kubernetes, MLOps, Vector Databases (Milvus/Qdrant), GPU Management, Ray, Docker, Triton
What you will work on:
- Build and operate distributed GPU compute clusters for model training and high-throughput inference serving.
- Deploy and maintain enterprise vector database installations and high-speed semantic index platforms.
- Develop custom platform abstractions, APIs, and CLI tools enabling machine learning teams to ship models seamlessly.
- Optimize model serving engines (Triton/vLLM) for ultra-low latency and efficient hardware utilization.
What we are looking for:
- Hands-on experience engineering infrastructure platforms for ML/AI workloads and GPU orchestration.
- Advanced mastery of Kubernetes, Docker containerization, vector datastores, and high-performance serving frameworks.
- Strong background in Python, distributed compute execution, and Linux systems administration.