In this paper, we propose a conceptually simple but very effective attention module for Convolutional Neural Networks (ConvNets). In contrast to existing channel-wise and spatial-wise attention ...
at::Tensor new_w = p.conv_w * (p.bn_w * bn_var_rsqrt).reshape(sizes); at::Tensor new_b = (p.conv_b - p.bn_rm) * bn_var_rsqrt * p.bn_w + p.bn_b; ...