How & Why We Update Models 100 Times a Day at Funcorp // Gleb Abroskin // MLOps Coffee Sessions #123

MLOps Coffee Sessions #123 with Gleb Abroskin, Machine Learning Engineer at Funcorp, How & Why We Update Models 100 Times a Day at Funcorp co-hosted by Jake Noble.

// Abstract
FunCorp was a top 10 app store. It was a very popular app that has a ton of downloads and just memes. They need a recommendation system on top of that. Memes are super tricky because they're user-generated and they evolve very quickly. They're going to live and die by the Recommender System in that product.

It's incredible to see FunCorp's maturity. Gleb breaks down the feature store they created and the velocity they have to be able to create a whole new pipeline in a new model and put it into production after only 2 weeks or a month!

// Bio
Gleb make models go brrrrr. He doesn't know what is expected in this field, to be honest, but Gleb has experience in deploying a lot of different ML models for CV, speech recognition, and RecSys in a variety of languages (C++, Python, Kotlin) serving millions of users worldwide.

/ MLOps Jobs board  
https://mlops.pallet.xyz/jobs

MLOps Swag/Merch
https://mlops-community.myshopify.com/

// Related Links

--------------- ✌️Connect With Us ✌️ -------------
Join our slack community: https://go.mlops.community/slack
Follow us on Twitter: @mlopscommunity
Sign up for the next meetup: https://go.mlops.community/register
Catch all episodes, blogs, newsletters, and more: https://mlops.community/

Connect with Demetrios on LinkedIn: https://www.linkedin.com/in/dpbrinkm/
Connect with Jake on LinkedIn: https://www.linkedin.com/in/jakednoble/
Connect with Gleb on LinkedIn: https://www.linkedin.com/in/gasabr/

Timestamps:
[00:00] Introduction to Gleb Abroskin
[00:50] Takeaways
[05:39] Breakdown of FunCorp teams
[06:47] FunCorp's team ratio
[07:41] FunCorp team provisions
[08:48] Feature Store vision
[10:16] Matrix factorization
[11:51] Fairly modular fairly thin infrastructure
[12:26] Distinct models with the same feature
[13:08] FunCorp's definition of Feature Store
[15:10] Unified API
[15:55] FunCorp's scaling direction
[17:01] Level up as needed
[17:38] Future of FunCorp's Feature Store
[18:37] Monitoring investment in the space
[19:43] Latency for business metrics
[21:04] Velocity to production
[23:10] 30-day retention struggle
[24:45] Back-end business stability
[27:49] Recommender systems
[30:34] Back-end layer headaches
[32:04] Missing piece of the whole Feature Store picture
[33:54] Throwing ideas turn around time
[36:37] Decrease time to market
[37:41] Continuous training pipelines or produce an artifact
[39:33] Worst-case scenario
[40:38] Realistic estimation of a new model deployment
[41:42] Recommender Systems' future velocity  
[43:07] A/B Testing launch - no launch decision
[46:32] Lightning question
[47:08] Wrap up

Episode source