Tag Archives: control

Importance Sampling – A Tutorial

Posted on October 22, 2017 by machinelearning1

Problem: Compute an expectation over a probability density function , given only samples generated from a different probability density function . We call and the target distribution and proposal distribution respectively. Solution: Draw samples from Calculate the probability of each … Continue reading →

Posted in Machine Learning, MATLAB, Optimization, Reinforcement Learning, Robotics, Software, Statistics | Tagged , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , | 1 Comment

Iterative Learning Control – Part 2

Posted on February 9, 2017 by machinelearning1

In the previous post I explained the ILC controllers and compared them to the conventional feedback controllers. In this post I show a simple example that employs an ILC. Check the following simple, linear plant: In this system, is the … Continue reading →

Posted in control, Machine Learning, MATLAB, Optimization, programming, Robotics, Software | Tagged , , , , , , , , , , , , , , , , , , | 3 Comments

Iterative Learning Control – Part 1

Posted on February 9, 2017 by machinelearning1

Iterative Learning Control (ILC) is used for improving the transient response in systems that perform repetitively. ILC tries to improve the response by adjusting the input to the plant based on the error observed in the previous iteration. A conventional … Continue reading →

Posted in control, Machine Learning, MATLAB, Optimization, programming, Robotics, Software | Tagged , , , , , , , , , , , , , , , , , , , , , | Leave a comment

Git – Version Control System – Basics (Video Tutorial)

Posted on July 1, 2013 by machinelearning1

1 – Part. 1 Version Control System 2- Part. 2 What is Git? 3- Part. 3 Get going main commands of Git:  $ git init myproject $ cd myproject $ git add . $ git commit -m “the first version of code” … Continue reading →

Posted in Git, Linux, programming, Software, Ubuntu | Tagged , , , , , , , , , , , , | Leave a comment

Rewards VS. Values (in the concept of Reinforcement Learning)

Posted on March 20, 2012 by machinelearning1

In the concept of Reinforcement Learning, we usually deal with two pretty similar keywords, reward and value, that can be confusing for beginners. In this brief post, I will mention the differences and actual definitions of these terms. Rewards are … Continue reading →

Posted in Machine Learning, Reinforcement Learning, Robotics, Thoughts | Tagged , , , , , , , , , , , , , | Leave a comment