Pytorch——tensor

How to under the tensor

  • tensor
    • [what is tensor ?](#what is tensor ?)
    • [what is the big deal ?](#what is the big deal ?)
    • [how to understond the relative concept about the tensor ?](#how to understond the relative concept about the tensor ?)

tensor

what is tensor ?

We talk about the " Tenser" which is used in ML community.

Actually, the tenser is used as a talk and terminology to refine and rename things that already exist:

Call the "scalar" (a data) as the zero dimensional tensor;

Call the "array" in the programming field as the one dimensional tensor;

Call the "matrix" as the two dimensional tensor;

Call the "video" as the n dimensional tensor;

So, it is boring from the perspective of the gay who create the definition of tensor.

what is the big deal ?

It holds data, weights and biases.

Can realize the hardware acceleration and Autograd !

how to understond the relative concept about the tensor ?

The chain rule:

The Chain Rule is a fundamental concept in calculus. It provides a method for finding the derivative of a composite function that is composed of two or more functions.
Backpropogration:

It is the application of the chain rule, It is an efficient method for computing the gradient of the loss function with respect to theweights of the network, enabling the adjustment of weights to minimize the error.
The automatic differentiation:

is the automatic tool to realize the backpropogation. Of course, the forepropogation also can be realized by the autograd of the Pytorch.

reference:
backpropogation
tensor------statQuest
chain rule

相关推荐
小小管写大大码19 分钟前
AI重排序API:优化搜索相关性
数据库·人工智能
OG one.Z20 分钟前
07_朴素贝叶斯
人工智能·机器学习
智能相对论44 分钟前
把AI装进OS、批量落地智慧服务,智能手机革命2.0来了
人工智能·智能手机
flying_13141 小时前
图神经网络分享系列-GAT(GRAPH ATTENTION NETWORKS) (一)
人工智能·神经网络·图神经网络·注意力机制·gnn·gat·图注意力网络
九皇叔叔1 小时前
Java循环结构全解析:从基础用法到性能优化(含经典案例)
java·开发语言·python
chxin140161 小时前
优化算法——动手学深度学习11
pytorch·python·深度学习
周末程序猿1 小时前
谈谈 `Claude Skills`
人工智能·ai编程
IT_陈寒2 小时前
5个Vue3性能优化技巧,让你的应用提速50% 🚀(附实测对比)
前端·人工智能·后端
kalvin_y_liu2 小时前
微软Agent Framework
人工智能·microsoft
ximy13352 小时前
AI服务器工作之显卡测试
人工智能