Batch Normalization
Backward Pass, Optimizer, Batch Normalization
· โ˜• 4 min read
๋“ค์–ด๊ฐ€๋ฉฐ 5์ฃผ์ฐจ ๊ฐ•์˜์— ์ ‘์–ด๋“ค์—ˆ๋‹ค. ์ด๋ฒˆ์žฅ์—์„œ๋Š” MLP์˜ ์ „๋ฐ˜์ ์ธ ๊ณผ์ •์— ๋Œ€ํ•œ ๋‚ด์šฉ์ด์—ˆ๊ณ , ๊ทธ์ค‘์—์„œ Forward Pass, Backward Pass์— ๋Œ€ํ•œ ๋‚ด์šฉ์ด ์ฃผ์š” ๋‚ด์šฉ์ด์—ˆ๋‹ค. ๊ทธ๋ฆฌ๊ณ  ์ตœ