Breaking News: Grepper is joining You.com. Read the official announcement!

group normalization

Testy Teira answered on June 27, 2021 Popularity 7/10 Helpfulness 1/10

answer group normalization

group normalization

Comment

-1

由此可以看出，GN和BN是有很多相似之处的，代码相比较BN改动只有一两行而已，论文给出的代码实现如下：
def GroupNorm(x, gamma, beta, G, eps=1e-5):
    # x: input features with shape [N,C,H,W]
    # gamma, beta: scale and offset, with shape [1,C,1,1]
    # G: number of groups for GN
    N, C, H, W = x.shape
    x = tf.reshape(x, [N, G, C // G, H, W])
    mean, var = tf.nn.moments(x, [2, 3, 4], keep dims=True)
    x = (x - mean) / tf.sqrt(var + eps)
    x = tf.reshape(x, [N, C, H, W])
    return x * gamma + beta

Popularity 7/10 Helpfulness 1/10 Language python

Source: zhuanlan.zhihu.com

Tags: group normalization python

Link to this answer
Share Copy Link