Software Engineer - Hosted Model Infrastructure
This role involves building and maintaining high-performance, secure model serving infrastructure for AI/ML models deployed in challenging environments such as air-gapped government systems and edge devices. You'll work across the full stack to enable reliable, observable, and reproducible deployment of frontier AI models on customer-controlled hardware with constrained resources. The position emphasizes end-to-end ownership, debugging in low-access environments, and integration with Palantir’s platform and security systems.