Animated AI

1 min read Original article ↗

I'm creating animations and instructional videos about neural networks. Check out my Patreon and YouTube channel!

Convolution

The Basic Algorithm

Watch the companion YouTube video: Fundamental Algorithm of Convolution in Neural Networks. The process of convolution in neural networks with a 3x3 kernel size

Padding

Companion video: Convolution Padding - Neural Networks

Stride

Companion video: Stride - Convolution in Neural Networks
Stride 1Stride 2
The process of convolution in neural networks with a 3x3 kernel size The process of convolution in neural networks with a 3x3 kernel size and a stride of 2x2
No Padding AKA "Valid"; Stride of 1 No Padding AKA "Valid"; Stride of 2
The process of convolution in neural networks with a 3x3 kernel size, a stride of 2x2, and a padding of 'SAME', i.e., 1 pixel on the top, bottom, left, and right.
[1,1,1,1] Padding AKA "Same"; Stride of 1 [1,1,1,1] Padding AKA "Same"; Stride of 2

Groups, Depthwise, and Depthwise-Separable

Watch the companion YouTube video: Groups, Depthwise, and Depthwise-Separable Convolution (Neural Networks).

Pixel Shuffle

Watch the companion YouTube video: Pixel Shuffle - Changing Resolution with Style

2x2 Block Size

3x3 Block Size

Licensed under the MIT License