AI Inference API Gateway Development
Employer not named by the sourceRemote
Frontier is not the employer and does not collect applications.
About this role
Java, Python, Cloud Computing, Machine Learning (ML), Backend Development, AI (Artificial Intelligence) HW/SW, API Development, Microservices, API Testing, FastAPI · 3. AI Model Inference API Gateway
Category: Backend Development / API Engineering Budget: £1,350 GBP — Fixed Price, 3 Milestones Project deadline: Saturday, 10 October 2026
Description: We're building a backend gateway that sits in front of one or more machine learning models and exposes them as a clean, versioned inference API. The gateway needs to handle request queuing under load, model version routing, response caching where appropriate, and consistent error handling when a model fails to return a result. This is a pure backend/API service — no UI work involved.
Key requirements: • Strong backend/API development skills (Python, Java, or C#) • Experience serving ML models via API (e.g. FastAPI, TorchServe, Triton, or similar) • Comfortable working with request queuing and rate-limiting under load • Solid testing discipline for API and pipeline reliability
Deliverables: • Working inference API endpoint(s) with versioned model routing • Request queuing/rate-limiting and error-handling logic • Test suite covering standard and edge-case inputs
Payment Structure — £1,350 GBP Fixed, 3 Milestones
Milestone 1 – Advance Payment: £540 • Paid upon project commencement and award of co