Machine Learning: Difference between revisions

From Leo's Notes
This page was last edited on 2 September 2017, at 23:43.
Created page with " == Introduction == Machine learning algorithms is an umbrella term that covers a range of generic algorithms which falls into two main categories: supervised learning and uns..."
 
No edit summary
Line 1: Line 1:


== Introduction ==
== Introduction ==
Machine learning algorithms is an umbrella term that covers a range of generic algorithms which falls into two main categories: supervised learning and unsupervised learning.
Machine learning algorithms is an umbrella term that covers a range of generic algorithms. There are other branches of machine learning such as supervised learning, unsupervised learning, and reinforcement learning.  Supervised learning is the most commonly used.


Supervised learning means you know the solution to a problem and you make the computer determine an acceptable solution which can then be applied to any other problem of the same type.
Supervised learning requires training a model with labeled training data (data with parameters and a solution). The supervised learning algorithm then generates a solution that is as close to the solution as possible. This solution can then be applied to any other problem of the same type.


Unsupervised learning is basically what data mining is: it attempts to look for hidden patterns in the data.
Unsupervised learning is basically what data mining is: it attempts to look for hidden patterns in the data.
Line 25: Line 25:
== See Also ==
== See Also ==
* https://medium.com/@ageitgey/machine-learning-is-fun-80ea3ec3c471
* https://medium.com/@ageitgey/machine-learning-is-fun-80ea3ec3c471
* https://www.lynda.com/Data-Science-tutorials/Build-simple-home-value-estimator/548594/598227-4.html

Revision as of 23:43, 2 September 2017

Introduction

Machine learning algorithms is an umbrella term that covers a range of generic algorithms. There are other branches of machine learning such as supervised learning, unsupervised learning, and reinforcement learning. Supervised learning is the most commonly used.

Supervised learning requires training a model with labeled training data (data with parameters and a solution). The supervised learning algorithm then generates a solution that is as close to the solution as possible. This solution can then be applied to any other problem of the same type.

Unsupervised learning is basically what data mining is: it attempts to look for hidden patterns in the data.

Multivariate Linear Regression

Multivariate linear regression is a 3 step algorithm that takes in a set of data (ie. the training data) with a solution and applies weights to a number of properties in order to get as close to the answer as possible.

The 3 steps are:

  1. For each parameter, set its weight to 1.0
  2. For every piece of data, see how far off the function using the given weights are off by. The average error amount is the cost of the function.
  3. Repeat step 2 with different weights to minimize the cost (ie. the error)

Step 3 requires picking new weights that reduces the cost. This can be done by something called a batch gradient descent which picks values that 'walks' down the gradient. Because of this, the data that can be handled with this approach has to be linear.


Other Topics


See Also