Bloque Residual Invertido
An Inverted Residual Block is a key architectural component used primarily in mobile redes neuronales, such as MobileNet. Its design aims to enhance eficiencia computacional while maintaining high rendimiento del modelo, particularly for tasks like clasificación de imágenes.
The concept of the Inverted Residual Block revolves around a few key operations. First, it employs a lightweight convolución separable en profundidad, which splits the convolution operation into two simpler parts: a depthwise convolution (which applies a single filter per input channel) followed by a pointwise convolution (which combines the outputs of the depthwise convolution). This significantly reduces the computational load compared to traditional convolutions.
Otro aspecto importante del Bloque Residual Invertido es el use of linear bottlenecks. In a typical block, the input is first expanded to a higher-dimensional space using a 1×1 convolution, then processed through the depthwise convolution, and finally reduced back to a lower-dimensional space with another 1×1 convolution. This ‘inverted’ structure allows for efficient processing, as it focuses on maintaining important features while discarding less relevant data.
The block also incorporates residual connections, allowing the input to bypass certain layers. This helps in preventing the vanishing gradient problem during training, making it easier to optimize deeper networks. Overall, the Inverted Residual Block is designed to maximize the performance of neural networks on mobile and edge devices, where recursos computacionales son limitados.