← Journal · · Announcement
Part two of the Inference platform article!
Well folks, on the last Friday of this year I'm wrapping up the series of Habr articles with the second part about the inference platform.
In the article I talked about how we implemented resource autoscaling, canary deploy, the inference graph, and how you can automate picking a Triton configuration.
Best time to brew yourself a hot drink and read about inference platforms :)
Next year, expect new articles from me too! I'm already planning to go into more detail about my repo with Triton tutorials, and about model navigator and analyzer.