其他分享
首页 > 其他分享> > batch size 会影响训练的计算效率吗?

batch size 会影响训练的计算效率吗?

作者:互联网

We also use a smaller mini-batch size of 256 without any noticeable performance degradation. This is in contrast to CURL and DrQ that both use a larger batch size of 512 to attain more stable training in the expense of computational efficiency.

                                  ----from Drqv-2

 

这里不是很明白,难道更大的batch size会影响学习的速度吗?

标签:mini,use,smaller,batch,computational,效率,size
来源: https://www.cnblogs.com/leifzhang/p/16577531.html