Pin's Blog

Sequential Data Modeling Three Types of Problems Next Step Prediction ex) ABCDE -> F Classification ex) ABCDE -> True/False Sequence Generation Machine Translation (기계 번역) Speech Recognition (음성 인식) Image Caption Generation (이미지에 캡션 생성 Types of Processes one to many Image Captioning (이미지 -> 문자열) many to one 감정 분석 (문자열 -> 감정) many to many 기계 번역 (문자열 -> 문자열) synched many to many (동일 길이의 many to ma..

Connections form cycles x_t: input at time t h_t: hidden state at time t f: is an activation function for the hidden layer (e.g. tanh) U, V, W: network parameters RNN shares the same parameters across all steps g: activation function for the output layer Long Term Dependency x_1 ~ x_(t-1) are encoded into h_(t-1) h_(t-1) has the information on the past It is a context to process x_t However, it ..