0.Revision: DNN dense 重义层 全连接


RNN处理带有序列的数据
1. What is RNNs?
linear layer


1.1 What is RNN?
tanh (-1, +1)


1.2 RNN Cell in PyTorch


1.3 How to use RNNCell


*先把维度搞清楚 多了一个序列的维度
2. How to use RNN



2.1 How to use RNN - numLayers

2.2 How to use RNN

如果有batch_first:

3. Example 12-1:Using RNNCell
seq->seq

独热向量



Code-Prepare Data

Design Model

Loss and Optimizer

Training Cycle

Result

4. Example 12-2:Using RNN

Change Model


Result

5. Associate a vetcor with a word/character

嵌入层
5.1 One hot vs embedding
数据降维

5.2 Embedding in PyTorch


6. Example 12-3:Using embedding and linear layer





7. Exercise 12 - 1 Using LSTM

8. Exercise 12 - 1 Using GRU

知识点:
1.序列Data
2.循环共享