DataScience/DeepLearning

[딥러닝 필기] week3. Neural Networks - Learning Algorithm

neopin 2022. 3. 5. 12:41

Learning Algorithm

Learning with Gradient Descent Method

Randomly choose an initial solution, 

 

Composition Function Differentiation: 합성함수의 미분

 

Error Back Propagation

  • Hard Limit Function: ex) Step Function
  • Basic Idea
    • Given Input-Targets Pairs and output of NN
    • Minimize the error

Case 1: Weights between output and hidden layer

for Dn = (xn1, xn2, ..., xnd, tnd, tn1, tn2, ..., tnm