nn.Xxx nn.functional.xxx nn.Conv2d nn.functional.conv2d nn.Dropout nn.functional.dropout dropout.

tocrch.nn torch.nn nnautograd nn.Parameter nn.Linear&nn.conv2d nn.functional nn.Module nn.Sequential.

nn.Emedding () shape .

Understanding the Context

Linear+SoftmaxSoftmaxnn.Transformer nn.Transformernn.TransformerEncodernn.TransformerDecoder .

pytorchnn.embedding pytorchnn.embeddingword2vec (skip-gram cbow) 28 .

() .

torch.nn.Linear ()biasFalse (bias=True) bias.

Key Insights

Pytorchnn.CrossEntropyLoss ()weight label0-30123lossweight weight .

nn.Module .

Pytorch nn.AdaptiveAvgPool2d (output_size) ? : nn.AdaptiveAvgPo