{"id":4305,"date":"2017-06-05T06:29:25","date_gmt":"2017-06-05T00:59:25","guid":{"rendered":"http:\/\/www.allerin.com\/blog\/?p=4305"},"modified":"2017-06-05T11:55:29","modified_gmt":"2017-06-05T06:25:29","slug":"best-practices-in-machine-learning","status":"publish","type":"post","link":"https:\/\/www.allerin.com\/blog\/best-practices-in-machine-learning\/","title":{"rendered":"Best practices in machine learning"},"content":{"rendered":"

\"\"<\/a><\/p>\n

Machine learning has given rise to several practical applications that fulfill real business interests such as saving time and money. Machine learning has the potential to dramatically impact the future of your organization. Through applications such as virtual assistant solutions, machine learning automates tasks that would otherwise need to be performed by a live agent. Machine learning has made dramatic improvements in the past few years, but we are still very far from reaching human performance levels. Many a times, a machine needs the assistance of a human to complete its task. This is why, it is necessary for organizations to learn best practices in machine learning.<\/p>\n

<\/h6>\n

For the correct implementation of a machine learning algorithm, organizations are required to study machine learning use cases and execute best practices. Some such best practices include:<\/p>\n

\u2018Importance Weight\u2019 of your Sampled Data<\/h1>\n

\"\"<\/a><\/p>\n

When your organization has too much data, there is a temptation to take some files and drop rest of them. Dropping data while training your machine learning algorithms can cause several issues. Importance weighting<\/a> means that if you decide that you are going to sample example X with a 30% probability, then give it a weight of 10\/3. Thus, by importance weighting, all of the calibration properties are discussed and addressed.<\/p>\n

Reuse Code<\/h1>\n

You must reuse code between your training pipeline and your serving pipeline whenever it is possible. Batch processing methods are different than online processing methods. In online processing, you have to handle each request as it arrives, whereas, in batch processing you have to combine tasks.<\/p>\n

<\/h6>\n

At serving time, you are doing online processing, while training is a batch processing task. For using the code, you can create an object that is particular to your system. You should be able to store the result of any queries or joins in a very human readable way.<\/p>\n

<\/h6>\n

Then, once you have gathered all the information, during serving or training, you should be able to run a common method for bridging between the human readable object that is specific to your system and whatever format the machine learning system expects.<\/p>\n

Avoid Unaligned Objectives<\/h1>\n

While measuring the performance of your machine learning system, your team will start to look at issues that are outside the scope of the objectives of your current system. If your product goals are not covered by the existing algorithmic objective, then you must either change your objective or your product goals. For instance, you may optimize clicks or downloads, but make launch decisions based in part on human raters.<\/p>\n

Keep Ensembles Simple<\/h1>\n

Unified models are those models that take in raw features and directly rank content. These models are the easiest models to debug and understand. However, an ensemble of models works better. To keep things simple, each model must either be an ensemble, only taking the input of other models, or it can be a base model taking many features, but not both<\/p>\n

<\/h6>\n

If your organization is having models on top of other models that are trained separately, then combining such models can result in bad behavior. You must use a simple model for ensemble that takes only the output of your \u201cbase\u201d models as inputs. You can enforce properties on these ensemble models. For example, an increase in the score produced by a base model should not decrease the score of the ensemble.<\/p>\n

<\/h6>\n

Thus, implementing these best practices can ensure successful implementation of machine learning<\/a> algorithms.<\/p>\n","protected":false},"excerpt":{"rendered":"

Machine learning has given rise to several practical applications that fulfill real business interests such as saving time and money. Machine learning has the potential to dramatically impact the future…<\/p>\n","protected":false},"author":1,"featured_media":4486,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":"","_links_to":"","_links_to_target":""},"categories":[125,3],"tags":[348],"class_list":["post-4305","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-iot","category-technology","tag-best-practices-in-machine-learning"],"yoast_head":"\nBest practices in machine learning | Artificial Intelligence |<\/title>\n<meta name=\"description\" content=\"Organizations must, therefore, learn about the best practices in machine learning and ensure its proper implementation in their business\" \/>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/www.allerin.com\/blog\/best-practices-in-machine-learning\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Best practices in machine learning\" \/>\n<meta property=\"og:description\" content=\"Machine learning has given rise to several practical applications that fulfill real business interests such as saving time and money. Machine learning has\" \/>\n<meta property=\"og:url\" content=\"https:\/\/www.allerin.com\/blog\/best-practices-in-machine-learning\/\" \/>\n<meta property=\"og:site_name\" content=\"Allerin\" \/>\n<meta property=\"article:publisher\" content=\"https:\/\/www.facebook.com\/allerintech\" \/>\n<meta property=\"article:published_time\" content=\"2017-06-05T00:59:25+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2017-06-05T06:25:29+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/www.allerin.com\/wp-blog\/wp-content\/uploads\/2017\/06\/Best-practices-in-machine-learning.jpg\" \/>\n\t<meta property=\"og:image:width\" content=\"770\" \/>\n\t<meta property=\"og:image:height\" content=\"513\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/jpeg\" \/>\n<meta name=\"author\" content=\"Naveen Joshi\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:creator\" content=\"@joshinav\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"Naveen Joshi\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"3 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\\\/\\\/schema.org\",\"@graph\":[{\"@type\":\"Article\",\"@id\":\"https:\\\/\\\/www.allerin.com\\\/blog\\\/best-practices-in-machine-learning\\\/#article\",\"isPartOf\":{\"@id\":\"https:\\\/\\\/www.allerin.com\\\/blog\\\/best-practices-in-machine-learning\\\/\"},\"author\":{\"name\":\"Naveen Joshi\",\"@id\":\"https:\\\/\\\/www.allerin.com\\\/blog\\\/#\\\/schema\\\/person\\\/d01e43be365179dae3ff572b2007c64e\"},\"headline\":\"Best practices in machine learning\",\"datePublished\":\"2017-06-05T00:59:25+00:00\",\"dateModified\":\"2017-06-05T06:25:29+00:00\",\"mainEntityOfPage\":{\"@id\":\"https:\\\/\\\/www.allerin.com\\\/blog\\\/best-practices-in-machine-learning\\\/\"},\"wordCount\":575,\"commentCount\":0,\"publisher\":{\"@id\":\"https:\\\/\\\/www.allerin.com\\\/blog\\\/#organization\"},\"image\":{\"@id\":\"https:\\\/\\\/www.allerin.com\\\/blog\\\/best-practices-in-machine-learning\\\/#primaryimage\"},\"thumbnailUrl\":\"https:\\\/\\\/www.allerin.com\\\/blog\\\/wp-content\\\/uploads\\\/2017\\\/06\\\/Best-practices-in-machine-learning.jpg\",\"keywords\":[\"best practices in machine learning\"],\"articleSection\":[\"IOT\",\"Technology\"],\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"CommentAction\",\"name\":\"Comment\",\"target\":[\"https:\\\/\\\/www.allerin.com\\\/blog\\\/best-practices-in-machine-learning\\\/#respond\"]}]},{\"@type\":\"WebPage\",\"@id\":\"https:\\\/\\\/www.allerin.com\\\/blog\\\/best-practices-in-machine-learning\\\/\",\"url\":\"https:\\\/\\\/www.allerin.com\\\/blog\\\/best-practices-in-machine-learning\\\/\",\"name\":\"Best practices in machine learning | Artificial Intelligence |\",\"isPartOf\":{\"@id\":\"https:\\\/\\\/www.allerin.com\\\/blog\\\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\\\/\\\/www.allerin.com\\\/blog\\\/best-practices-in-machine-learning\\\/#primaryimage\"},\"image\":{\"@id\":\"https:\\\/\\\/www.allerin.com\\\/blog\\\/best-practices-in-machine-learning\\\/#primaryimage\"},\"thumbnailUrl\":\"https:\\\/\\\/www.allerin.com\\\/blog\\\/wp-content\\\/uploads\\\/2017\\\/06\\\/Best-practices-in-machine-learning.jpg\",\"datePublished\":\"2017-06-05T00:59:25+00:00\",\"dateModified\":\"2017-06-05T06:25:29+00:00\",\"description\":\"Organizations must, therefore, learn about the best practices in machine learning and ensure its proper implementation in their business\",\"breadcrumb\":{\"@id\":\"https:\\\/\\\/www.allerin.com\\\/blog\\\/best-practices-in-machine-learning\\\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\\\/\\\/www.allerin.com\\\/blog\\\/best-practices-in-machine-learning\\\/\"]}]},{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\\\/\\\/www.allerin.com\\\/blog\\\/best-practices-in-machine-learning\\\/#primaryimage\",\"url\":\"https:\\\/\\\/www.allerin.com\\\/blog\\\/wp-content\\\/uploads\\\/2017\\\/06\\\/Best-practices-in-machine-learning.jpg\",\"contentUrl\":\"https:\\\/\\\/www.allerin.com\\\/blog\\\/wp-content\\\/uploads\\\/2017\\\/06\\\/Best-practices-in-machine-learning.jpg\",\"width\":770,\"height\":513},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\\\/\\\/www.allerin.com\\\/blog\\\/best-practices-in-machine-learning\\\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\\\/\\\/www.allerin.com\\\/blog\\\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Best practices in machine learning\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\\\/\\\/www.allerin.com\\\/blog\\\/#website\",\"url\":\"https:\\\/\\\/www.allerin.com\\\/blog\\\/\",\"name\":\"Allerin\",\"description\":\"AI engineering for enterprise teams\",\"publisher\":{\"@id\":\"https:\\\/\\\/www.allerin.com\\\/blog\\\/#organization\"},\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\\\/\\\/www.allerin.com\\\/blog\\\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en-US\"},{\"@type\":\"Organization\",\"@id\":\"https:\\\/\\\/www.allerin.com\\\/blog\\\/#organization\",\"name\":\"Allerin\",\"url\":\"https:\\\/\\\/www.allerin.com\\\/blog\\\/\",\"logo\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\\\/\\\/www.allerin.com\\\/blog\\\/#\\\/schema\\\/logo\\\/image\\\/\",\"url\":\"https:\\\/\\\/www.allerin.com\\\/blog\\\/wp-content\\\/uploads\\\/2016\\\/06\\\/logo-fire.png\",\"contentUrl\":\"https:\\\/\\\/www.allerin.com\\\/blog\\\/wp-content\\\/uploads\\\/2016\\\/06\\\/logo-fire.png\",\"width\":1000,\"height\":1000,\"caption\":\"Allerin\"},\"image\":{\"@id\":\"https:\\\/\\\/www.allerin.com\\\/blog\\\/#\\\/schema\\\/logo\\\/image\\\/\"},\"sameAs\":[\"https:\\\/\\\/www.facebook.com\\\/allerintech\",\"https:\\\/\\\/www.linkedin.com\\\/company\\\/allerintech\"]},{\"@type\":\"Person\",\"@id\":\"https:\\\/\\\/www.allerin.com\\\/blog\\\/#\\\/schema\\\/person\\\/d01e43be365179dae3ff572b2007c64e\",\"name\":\"Naveen Joshi\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\\\/\\\/secure.gravatar.com\\\/avatar\\\/84481da5c6f8416248744f676c850c7dec534781024b854c7f3d26d2586a9f53?s=96&d=mm&r=g\",\"url\":\"https:\\\/\\\/secure.gravatar.com\\\/avatar\\\/84481da5c6f8416248744f676c850c7dec534781024b854c7f3d26d2586a9f53?s=96&d=mm&r=g\",\"contentUrl\":\"https:\\\/\\\/secure.gravatar.com\\\/avatar\\\/84481da5c6f8416248744f676c850c7dec534781024b854c7f3d26d2586a9f53?s=96&d=mm&r=g\",\"caption\":\"Naveen Joshi\"},\"sameAs\":[\"https:\\\/\\\/x.com\\\/joshinav\"],\"url\":\"https:\\\/\\\/www.allerin.com\\\/blog\\\/author\\\/admin\\\/\"}]}<\/script>\n<!-- \/ Yoast SEO Premium plugin. -->","yoast_head_json":{"title":"Best practices in machine learning | Artificial Intelligence |","description":"Organizations must, therefore, learn about the best practices in machine learning and ensure its proper implementation in their business","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/www.allerin.com\/blog\/best-practices-in-machine-learning\/","og_locale":"en_US","og_type":"article","og_title":"Best practices in machine learning","og_description":"Machine learning has given rise to several practical applications that fulfill real business interests such as saving time and money. Machine learning has","og_url":"https:\/\/www.allerin.com\/blog\/best-practices-in-machine-learning\/","og_site_name":"Allerin","article_publisher":"https:\/\/www.facebook.com\/allerintech","article_published_time":"2017-06-05T00:59:25+00:00","article_modified_time":"2017-06-05T06:25:29+00:00","og_image":[{"width":770,"height":513,"url":"https:\/\/www.allerin.com\/wp-blog\/wp-content\/uploads\/2017\/06\/Best-practices-in-machine-learning.jpg","type":"image\/jpeg"}],"author":"Naveen Joshi","twitter_card":"summary_large_image","twitter_creator":"@joshinav","twitter_misc":{"Written by":"Naveen Joshi","Est. reading time":"3 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"Article","@id":"https:\/\/www.allerin.com\/blog\/best-practices-in-machine-learning\/#article","isPartOf":{"@id":"https:\/\/www.allerin.com\/blog\/best-practices-in-machine-learning\/"},"author":{"name":"Naveen Joshi","@id":"https:\/\/www.allerin.com\/blog\/#\/schema\/person\/d01e43be365179dae3ff572b2007c64e"},"headline":"Best practices in machine learning","datePublished":"2017-06-05T00:59:25+00:00","dateModified":"2017-06-05T06:25:29+00:00","mainEntityOfPage":{"@id":"https:\/\/www.allerin.com\/blog\/best-practices-in-machine-learning\/"},"wordCount":575,"commentCount":0,"publisher":{"@id":"https:\/\/www.allerin.com\/blog\/#organization"},"image":{"@id":"https:\/\/www.allerin.com\/blog\/best-practices-in-machine-learning\/#primaryimage"},"thumbnailUrl":"https:\/\/www.allerin.com\/blog\/wp-content\/uploads\/2017\/06\/Best-practices-in-machine-learning.jpg","keywords":["best practices in machine learning"],"articleSection":["IOT","Technology"],"inLanguage":"en-US","potentialAction":[{"@type":"CommentAction","name":"Comment","target":["https:\/\/www.allerin.com\/blog\/best-practices-in-machine-learning\/#respond"]}]},{"@type":"WebPage","@id":"https:\/\/www.allerin.com\/blog\/best-practices-in-machine-learning\/","url":"https:\/\/www.allerin.com\/blog\/best-practices-in-machine-learning\/","name":"Best practices in machine learning | Artificial Intelligence |","isPartOf":{"@id":"https:\/\/www.allerin.com\/blog\/#website"},"primaryImageOfPage":{"@id":"https:\/\/www.allerin.com\/blog\/best-practices-in-machine-learning\/#primaryimage"},"image":{"@id":"https:\/\/www.allerin.com\/blog\/best-practices-in-machine-learning\/#primaryimage"},"thumbnailUrl":"https:\/\/www.allerin.com\/blog\/wp-content\/uploads\/2017\/06\/Best-practices-in-machine-learning.jpg","datePublished":"2017-06-05T00:59:25+00:00","dateModified":"2017-06-05T06:25:29+00:00","description":"Organizations must, therefore, learn about the best practices in machine learning and ensure its proper implementation in their business","breadcrumb":{"@id":"https:\/\/www.allerin.com\/blog\/best-practices-in-machine-learning\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/www.allerin.com\/blog\/best-practices-in-machine-learning\/"]}]},{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/www.allerin.com\/blog\/best-practices-in-machine-learning\/#primaryimage","url":"https:\/\/www.allerin.com\/blog\/wp-content\/uploads\/2017\/06\/Best-practices-in-machine-learning.jpg","contentUrl":"https:\/\/www.allerin.com\/blog\/wp-content\/uploads\/2017\/06\/Best-practices-in-machine-learning.jpg","width":770,"height":513},{"@type":"BreadcrumbList","@id":"https:\/\/www.allerin.com\/blog\/best-practices-in-machine-learning\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/www.allerin.com\/blog\/"},{"@type":"ListItem","position":2,"name":"Best practices in machine learning"}]},{"@type":"WebSite","@id":"https:\/\/www.allerin.com\/blog\/#website","url":"https:\/\/www.allerin.com\/blog\/","name":"Allerin","description":"AI engineering for enterprise teams","publisher":{"@id":"https:\/\/www.allerin.com\/blog\/#organization"},"potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/www.allerin.com\/blog\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"},{"@type":"Organization","@id":"https:\/\/www.allerin.com\/blog\/#organization","name":"Allerin","url":"https:\/\/www.allerin.com\/blog\/","logo":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/www.allerin.com\/blog\/#\/schema\/logo\/image\/","url":"https:\/\/www.allerin.com\/blog\/wp-content\/uploads\/2016\/06\/logo-fire.png","contentUrl":"https:\/\/www.allerin.com\/blog\/wp-content\/uploads\/2016\/06\/logo-fire.png","width":1000,"height":1000,"caption":"Allerin"},"image":{"@id":"https:\/\/www.allerin.com\/blog\/#\/schema\/logo\/image\/"},"sameAs":["https:\/\/www.facebook.com\/allerintech","https:\/\/www.linkedin.com\/company\/allerintech"]},{"@type":"Person","@id":"https:\/\/www.allerin.com\/blog\/#\/schema\/person\/d01e43be365179dae3ff572b2007c64e","name":"Naveen Joshi","image":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/secure.gravatar.com\/avatar\/84481da5c6f8416248744f676c850c7dec534781024b854c7f3d26d2586a9f53?s=96&d=mm&r=g","url":"https:\/\/secure.gravatar.com\/avatar\/84481da5c6f8416248744f676c850c7dec534781024b854c7f3d26d2586a9f53?s=96&d=mm&r=g","contentUrl":"https:\/\/secure.gravatar.com\/avatar\/84481da5c6f8416248744f676c850c7dec534781024b854c7f3d26d2586a9f53?s=96&d=mm&r=g","caption":"Naveen Joshi"},"sameAs":["https:\/\/x.com\/joshinav"],"url":"https:\/\/www.allerin.com\/blog\/author\/admin\/"}]}},"_links":{"self":[{"href":"https:\/\/www.allerin.com\/blog\/wp-json\/wp\/v2\/posts\/4305","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.allerin.com\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.allerin.com\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.allerin.com\/blog\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/www.allerin.com\/blog\/wp-json\/wp\/v2\/comments?post=4305"}],"version-history":[{"count":4,"href":"https:\/\/www.allerin.com\/blog\/wp-json\/wp\/v2\/posts\/4305\/revisions"}],"predecessor-version":[{"id":4488,"href":"https:\/\/www.allerin.com\/blog\/wp-json\/wp\/v2\/posts\/4305\/revisions\/4488"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.allerin.com\/blog\/wp-json\/wp\/v2\/media\/4486"}],"wp:attachment":[{"href":"https:\/\/www.allerin.com\/blog\/wp-json\/wp\/v2\/media?parent=4305"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.allerin.com\/blog\/wp-json\/wp\/v2\/categories?post=4305"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.allerin.com\/blog\/wp-json\/wp\/v2\/tags?post=4305"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}