DevsData is looking for Senior Software Engineer
$70.000 - $100.000 USD Yearly
100% Remote
Full-time
B2B Contract

We’re hiring an experienced Senior Software Engineer to join the core team building a high-performance MLOps platform. This is a backend-heavy role that blends DevOps and software engineering, supporting large-scale batch and real-time inference pipelines used in advanced ML applications.
You'll work closely with a global, highly skilled team to build and maintain reliable infrastructure that powers cutting-edge machine learning workflows.

Requirements

• 8+ years of experience in backend or systems engineering
• Strong hands-on experience with Python in production environments
• Deep understanding of cloud infrastructure (especially AWS) – architecture, scalability, security
• Solid knowledge of Kubernetes, including managing multiple clusters and scaling large workloads
• Experience designing and building microservices architectures
• Familiarity with the ML lifecycle (model training, deployment, monitoring)
• Experience working in DevOps-heavy environments (CI/CD, observability, containerization)

Responsibilities

• Design and implement scalable, fault-tolerant backend infrastructure for ML inference (batch and real-time)
• Collaborate with ML engineers, DevOps, and SREs to deliver production-ready ML pipelines
• Lead technical design discussions and guide architectural decisions for Python-based systems
• Develop infrastructure using Python, AWS, Kubernetes, and related technologies
• Implement and maintain observability tools (e.g., Prometheus, Grafana, OpenTelemetry)
• Foster a strong engineering culture by mentoring teammates and promoting clean code, testing, and documentation

Nice to Have

• Experience with FastAPI and async Python frameworks
• Familiarity with Ray, Kubeflow, or other ML pipeline orchestration tools
• Hands-on experience with Terraform, ArgoCD, or other infrastructure-as-code / GitOps tools
• Knowledge of SQLAlchemy (asyncpg)
• Previous experience in high-growth or scaling ML platforms

Get to know DevsData
We are a technology consulting company and a recruitment agency, delivering software solutions to clients from Europe and the US. We work 100% remotely, in an international team. We employ people with experience in international corporations as well as the ones from the best technical and business universities.
Find out more: https://devsdata.com

Please send your CV to the following email address: aria.jerjian@devsdata.com