large classifieds marketplaceML platform
An ML platform on Kubeflow for 1000+ users
15%→~60%
GPU utilization: from a DevBox per person to one platform
~1000 MAU~70k runs/monthKubeflow · Kueue · Istio
Cases
ML and inference platforms, an MLOps course and mentoring. Each case covers what it was, what we did and what changed, with numbers wherever I can show them.
large classifieds marketplaceinference
An inference platform on KServe for ML and LLMs
days→minutes
from a model in the registry to production, instead of a web service in the PaaS mixed with business logic
>10k RPSgeo-distributed clusterprefill/decode
cloud providerML platform
An on-demand ML platform on ClearML
8 h→24 min
to deploy the platform for a client
bankNDA
An on-prem ML platform on ClearML
Helm → prod
a platform on the bank's servers and a churn model with automated training and rollout
Yandex Practicumeducation
The "MLOps for model development and monitoring" course
10 modules
program expert for every module: responsible for the curriculum
getMentormentoring
20+ one-on-one consultations
Anton does not just know the subject - he is a practicing professional, and his answers come from hands-on experience.
George