Data science today is a lot like the Wild West: there’s endless opportunity and
excitement, but also a lot of chaos and confusion. If you’re new to data science and
applied machine learning, evaluating a machine-learning model can seem pretty overwhelming.
Now you have help. With this O’Reilly report, machine-learning expert Alice Zheng takes
you through the model evaluation basics.
In this overview, Zheng first introduces the machine-learning workflow, and then dives into
evaluation metrics and model selection. The latter half of the report focuses on
hyperparameter tuning and A/B testing, which may benefit more seasoned machine-learning
practitioners.
With this report, you will:
Learn the stages involved when developing a machine-learning model for use in a software
application
Understand the metrics used for supervised learning models, including classification,
regression, and ranking
Walk through evaluation mechanisms, such as hold?out validation, cross-validation, and
bootstrapping
Explore hyperparameter tuning in detail, and discover why it’s so difficult
Learn the pitfalls of A/B testing, and examine a promising alternative: multi-armed bandits
Get suggestions for further reading, as well as useful software packages
Alice Zheng is the Director of Data Science at Dato, a Seattle-based startup that offers
powerful large-scale machine learning and graph analytics tools. A tool builder and an
expert in machine-learning algorithms, her research spans software diagnosis, computer
network security, and social network analysis.
具體描述
讀後感
評分
評分
評分
評分
用戶評價
梳理瞭下機器學習模型評估的體係，比較基礎，但思路挺清晰。
评分梳理瞭下機器學習模型評估的體係，比較基礎，但思路挺清晰。
评分實用～
评分20171115：有關模型評估的小冊子，實用。1）工作流程分為原型階段與發布階段，原型階段需要對模型來驗證和離綫評估，發布階段需要在綫評估。離綫評估和在綫評估用的指標不一樣，當然數據集也不同。有可能存在分布漂移。2）迴歸指標評價。3）A/B測試。
评分實用～
相關圖書
本站所有內容均為互聯網搜索引擎提供的公開搜索信息，本站不存儲任何數據與內容，任何內容與數據均與本站無關，如有需要請聯繫相關搜索引擎包括但不限於百度，google,bing,sogou 等
© 2025 book.quotespace.org All Rights Reserved. 小美書屋 版权所有