Computer Science 8751
Advanced Machine Learning
Homework Assignment 2 (20 points)
Due October 11, 2006

For the following set of examples:

• a1, b1, c1, d1, +
• a2, b2, c2, d2, -
• a3, b1, c3, d1, -
• a2, b1, c2, d2, +
• a1, b2, c3, d1, -
• a2, b1, c2, d2, +
• a3, b2, c3, d2, -
• a2, b1, c3, d2, -

1. Calculate the decision tree that would be produced by ID3, show all of your work.
2. Assuming a multlayer percentron with one hidden layer of four units and that all weights are initially 0. Then set the weight from each hidden unit to the 1 unit to 0.1 times the unit number (first unit's weight to the 1 unit is 0.1, second is 0.2, etc.). Show your input and output representation, then show the weight change calculated for the first two steps of incremental training. Show your work.