( A, B )---3*30*2---( 1, 0 )( 0, 1 )
让网络的输入只有3个节点,AB训练集各由6张二值化的图片组成,让A,B中各有5个点,并且让这10个点的位置没有重合。比较迭代次数的顺序。
其中有18组数据
|---|---|---|-----------------------------------|-------|---|---|---|---|-----|----------|---|---|---|---|-----|-------|---|-----------|
| 差值结构 ||| A-B | 迭代次数 || 构造平均列 ||| 平均列 | 列排斥能B || 构造平均列 ||| 平均列 | 列排斥能A || 排斥能的和 |
| 1 | 1 | 1 | 7*0*0*1*1*0-0*2*4*0*0*7 | 13628 | | | | | | | | | | | | | | |
| - | 2 | - | 7*0*0*1*1*0-0*2*4*0*0*7 | 13628 | | | 2 | | 2 | 9.833333 | | 1 | 1 | 3 | 5 | 17.75 | | 27.583333 |
| 2 | - | - | 7*0*0*1*1*0-0*2*4*0*0*7 | 13628 | | 2 | | | 2 | | | | | | 0 | | | |
| - | - | 1 | 7*0*0*1*1*0-0*2*4*0*0*7 | 13628 | | | | | 0 | | | | | | 0 | | | |
| - | - | 1 | 7*0*0*1*1*0-0*2*4*0*0*7 | 13628 | | | | | 0 | | | | | 3 | 3 | | | |
| 2 | 2 | 2 | 7*0*0*1*1*0-0*2*4*0*0*7 | 13628 | | 2 | 2 | 1 | 5 | | | | | 3 | 3 | | | |
| | | | | | | | | | 0 | | | | | | 0 | | | |
| 1 | 1 | 1 | 7*0*1*1*0*0-0*4*2*0*0*7 | 14020 | | | | | | | | | | | | | | |
| 2 | - | - | 7*0*1*1*0*0-0*4*2*0*0*7 | 14020 | | 2 | | | 2 | 9.833333 | | 1 | 1 | 3 | 5 | 21.5 | | 31.333333 |
| - | 2 | 1 | 7*0*1*1*0*0-0*4*2*0*0*7 | 14020 | | | 2 | | 2 | | | | | | 0 | | | |
| - | - | 1 | 7*0*1*1*0*0-0*4*2*0*0*7 | 14020 | | | | | 0 | | | | | 3 | 3 | | | |
| - | - | - | 7*0*1*1*0*0-0*4*2*0*0*7 | 14020 | | | | | 0 | | | | | 3 | 3 | | | |
| 2 | 2 | 2 | 7*0*1*1*0*0-0*4*2*0*0*7 | 14020 | | 2 | 2 | 1 | 5 | | | | | | 0 | | | |
| | | | | | | | | | 0 | | | | | | 0 | | | |
| 1 | 1 | 1 | 7*0*0*1*1*0-0*0*2*4*0*7 | 14056 | | | | | | | | | | | | | | |
| - | - | - | 7*0*0*1*1*0-0*0*2*4*0*7 | 14056 | | | | | 0 | 12.33333 | | 1 | 1 | 3 | 5 | 17.75 | | 30.083333 |
| - | 2 | - | 7*0*0*1*1*0-0*0*2*4*0*7 | 14056 | | | 2 | | 2 | | | | | | 0 | | | |
| 2 | - | 1 | 7*0*0*1*1*0-0*0*2*4*0*7 | 14056 | | 2 | | | 2 | | | | | | 0 | | | |
| - | - | 1 | 7*0*0*1*1*0-0*0*2*4*0*7 | 14056 | | | | | 0 | | | | | 3 | 3 | | | |
| 2 | 2 | 2 | 7*0*0*1*1*0-0*0*2*4*0*7 | 14056 | | 2 | 2 | 1 | 5 | | | | | 3 | 3 | | | |
| | | | | | | | | | 0 | | | | | | 0 | | | |
| 1 | 1 | 1 | 7*0*0*1*1*0-0*0*4*0*2*7 | 15764 | | | | | | | | | | | | | | |
| - | - | - | 7*0*0*1*1*0-0*0*4*0*2*7 | 15764 | | | | | 0 | 15.33333 | | 1 | 1 | 3 | 5 | 17.75 | | 33.083333 |
| 2 | - | - | 7*0*0*1*1*0-0*0*4*0*2*7 | 15764 | | 2 | | | 2 | | | | | | 0 | | | |
| - | - | 1 | 7*0*0*1*1*0-0*0*4*0*2*7 | 15764 | | | | | 0 | | | | | | 0 | | | |
| - | 2 | 1 | 7*0*0*1*1*0-0*0*4*0*2*7 | 15764 | | | 2 | | 2 | | | | | 3 | 3 | | | |
| 2 | 2 | 2 | 7*0*0*1*1*0-0*0*4*0*2*7 | 15764 | | 2 | 2 | 1 | 5 | | | | | 3 | 3 | | | |
| | | | | | | | | | 0 | | | | | | 0 | | | |
| 1 | 1 | 1 | 7*0*0*1*1*0-0*4*0*2*0*7 | 15780 | | | | | | | | | | | | | | |
| 2 | - | - | 7*0*0*1*1*0-0*4*0*2*0*7 | 15780 | | 2 | | | 2 | 9.5 | | 1 | 1 | 3 | 5 | 17.75 | | 27.25 |
| - | - | - | 7*0*0*1*1*0-0*4*0*2*0*7 | 15780 | | | | | 0 | | | | | | 0 | | | |
| - | 2 | 1 | 7*0*0*1*1*0-0*4*0*2*0*7 | 15780 | | | 2 | | 2 | | | | | | 0 | | | |
| - | - | 1 | 7*0*0*1*1*0-0*4*0*2*0*7 | 15780 | | | | | 0 | | | | | 3 | 3 | | | |
| 2 | 2 | 2 | 7*0*0*1*1*0-0*4*0*2*0*7 | 15780 | | 2 | 2 | 1 | 5 | | | | | 3 | 3 | | | |
| | | | | | | | | | 0 | | | | | | 0 | | | |
| 1 | 1 | 1 | 7*0*1*1*0*0-0*4*0*2*0*7 | 15841 | | | | | | | | | | | | | | |
| 2 | - | - | 7*0*1*1*0*0-0*4*0*2*0*7 | 15841 | | 2 | | | 2 | 9.5 | | 1 | 1 | 3 | 5 | 21.5 | | 31 |
| - | - | 1 | 7*0*1*1*0*0-0*4*0*2*0*7 | 15841 | | | | | 0 | | | | | | 0 | | | |
| - | 2 | 1 | 7*0*1*1*0*0-0*4*0*2*0*7 | 15841 | | | 2 | | 2 | | | | | 3 | 3 | | | |
| - | - | - | 7*0*1*1*0*0-0*4*0*2*0*7 | 15841 | | | | | 0 | | | | | 3 | 3 | | | |
| 2 | 2 | 2 | 7*0*1*1*0*0-0*4*0*2*0*7 | 15841 | | 2 | 2 | 1 | 5 | | | | | | 0 | | | |
| | | | | | | | | | 0 | | | | | | 0 | | | |
| 1 | 1 | 1 | 7*0*1*1*0*0-0*2*0*0*4*7 | 17216 | | | | | | | | | | | | | | |
| - | 2 | - | 7*0*1*1*0*0-0*2*0*0*4*7 | 17216 | | | 2 | | 2 | 13.83333 | | 1 | 1 | 3 | 5 | 21.5 | | 35.333333 |
| - | - | 1 | 7*0*1*1*0*0-0*2*0*0*4*7 | 17216 | | | | | 0 | | | | | | 0 | | | |
| - | - | 1 | 7*0*1*1*0*0-0*2*0*0*4*7 | 17216 | | | | | 0 | | | | | 3 | 3 | | | |
| 2 | - | - | 7*0*1*1*0*0-0*2*0*0*4*7 | 17216 | | 2 | | | 2 | | | | | 3 | 3 | | | |
| 2 | 2 | 2 | 7*0*1*1*0*0-0*2*0*0*4*7 | 17216 | | 2 | 2 | 1 | 5 | | | | | | 0 | | | |
| | | | | | | | | | 0 | | | | | | 0 | | | |
| 1 | 1 | 1 | 7*1*1*0*0*0-0*4*0*0*2*7 | 17512 | | | | | | | | | | | | | | |
| 2 | - | 1 | 7*1*1*0*0*0-0*4*0*0*2*7 | 17512 | | 2 | | | 2 | 13.83333 | | 1 | 1 | 3 | 5 | 31.5 | | 45.333333 |
| - | - | 1 | 7*1*1*0*0*0-0*4*0*0*2*7 | 17512 | | | | | 0 | | | | | 3 | 3 | | | |
| - | - | - | 7*1*1*0*0*0-0*4*0*0*2*7 | 17512 | | | | | 0 | | | | | 3 | 3 | | | |
| - | 2 | - | 7*1*1*0*0*0-0*4*0*0*2*7 | 17512 | | | 2 | | 2 | | | | | | 0 | | | |
| 2 | 2 | 2 | 7*1*1*0*0*0-0*4*0*0*2*7 | 17512 | | 2 | 2 | 1 | 5 | | | | | | 0 | | | |
| | | | | | | | | | 0 | | | | | | 0 | | | |
| 1 | 1 | 1 | 7*0*0*1*1*0-0*2*0*0*4*7 | 17845 | | | | | | | | | | | | | | |
| - | 2 | - | 7*0*0*1*1*0-0*2*0*0*4*7 | 17845 | | | 2 | | 2 | 13.83333 | | 1 | 1 | 3 | 5 | 17.75 | | 31.583333 |
| - | - | - | 7*0*0*1*1*0-0*2*0*0*4*7 | 17845 | | | | | 0 | | | | | | 0 | | | |
| - | - | 1 | 7*0*0*1*1*0-0*2*0*0*4*7 | 17845 | | | | | 0 | | | | | | 0 | | | |
| 2 | - | 1 | 7*0*0*1*1*0-0*2*0*0*4*7 | 17845 | | 2 | | | 2 | | | | | 3 | 3 | | | |
| 2 | 2 | 2 | 7*0*0*1*1*0-0*2*0*0*4*7 | 17845 | | 2 | 2 | 1 | 5 | | | | | 3 | 3 | | | |
| | | | | | | | | | 0 | | | | | | 0 | | | |
| 1 | 1 | 1 | 7*1*1*0*0*0-0*2*4*0*0*7 | 17897 | | | | | | | | | | | | | | |
| - | 2 | 1 | 7*1*1*0*0*0-0*2*4*0*0*7 | 17897 | | | 2 | | 2 | 9.833333 | | 1 | 1 | 3 | 5 | 31.5 | | 41.333333 |
| 2 | - | 1 | 7*1*1*0*0*0-0*2*4*0*0*7 | 17897 | | 2 | | | 2 | | | | | 3 | 3 | | | |
| - | - | - | 7*1*1*0*0*0-0*2*4*0*0*7 | 17897 | | | | | 0 | | | | | 3 | 3 | | | |
| - | - | - | 7*1*1*0*0*0-0*2*4*0*0*7 | 17897 | | | | | 0 | | | | | | 0 | | | |
| 2 | 2 | 2 | 7*1*1*0*0*0-0*2*4*0*0*7 | 17897 | | 2 | 2 | 1 | 5 | | | | | | 0 | | | |
| | | | | | | | | | 0 | | | | | | 0 | | | |
| 1 | 1 | 1 | 7*0*0*1*1*0-0*0*0*4*2*7 | 18243 | | | | | | | | | | | | | | |
| - | - | - | 7*0*0*1*1*0-0*0*0*4*2*7 | 18243 | | | | | 0 | 19 | | 1 | 1 | 3 | 5 | 17.75 | | 36.75 |
| - | - | - | 7*0*0*1*1*0-0*0*0*4*2*7 | 18243 | | | | | 0 | | | | | | 0 | | | |
| 2 | - | 1 | 7*0*0*1*1*0-0*0*0*4*2*7 | 18243 | | 2 | | | 2 | | | | | | 0 | | | |
| - | 2 | 1 | 7*0*0*1*1*0-0*0*0*4*2*7 | 18243 | | | 2 | | 2 | | | | | 3 | 3 | | | |
| 2 | 2 | 2 | 7*0*0*1*1*0-0*0*0*4*2*7 | 18243 | | 2 | 2 | 1 | 5 | | | | | 3 | 3 | | | |
| | | | | | | | | | 0 | | | | | | 0 | | | |
| 1 | 1 | 1 | 7*0*1*1*0*0-0*0*4*2*0*7 | 18286 | | | | | | | | | | | | | | |
| - | - | - | 7*0*1*1*0*0-0*0*4*2*0*7 | 18286 | | | | | 0 | 12.33333 | | 1 | 1 | 3 | 5 | 21.5 | | 33.833333 |
| 2 | - | 1 | 7*0*1*1*0*0-0*0*4*2*0*7 | 18286 | | 2 | | | 2 | | | | | | 0 | | | |
| - | 2 | 1 | 7*0*1*1*0*0-0*0*4*2*0*7 | 18286 | | | 2 | | 2 | | | | | 3 | 3 | | | |
| - | - | - | 7*0*1*1*0*0-0*0*4*2*0*7 | 18286 | | | | | 0 | | | | | 3 | 3 | | | |
| 2 | 2 | 2 | 7*0*1*1*0*0-0*0*4*2*0*7 | 18286 | | 2 | 2 | 1 | 5 | | | | | | 0 | | | |
| | | | | | | | | | 0 | | | | | | 0 | | | |
| 1 | 1 | 1 | 7*1*1*0*0*0-0*0*2*0*4*7 | 20054 | | | | | | | | | | | | | | |
| - | - | 1 | 7*1*1*0*0*0-0*0*2*0*4*7 | 20054 | | | | | 0 | 15.33333 | | 1 | 1 | 3 | 5 | 31.5 | | 46.833333 |
| - | 2 | 1 | 7*1*1*0*0*0-0*0*2*0*4*7 | 20054 | | | 2 | | 2 | | | | | 3 | 3 | | | |
| - | - | - | 7*1*1*0*0*0-0*0*2*0*4*7 | 20054 | | | | | 0 | | | | | 3 | 3 | | | |
| 2 | - | - | 7*1*1*0*0*0-0*0*2*0*4*7 | 20054 | | 2 | | | 2 | | | | | | 0 | | | |
| 2 | 2 | 2 | 7*1*1*0*0*0-0*0*2*0*4*7 | 20054 | | 2 | 2 | 1 | 5 | | | | | | 0 | | | |
| | | | | | | | | | 0 | | | | | | 0 | | | |
| 1 | 1 | 1 | 7*0*1*1*0*0-0*0*4*0*2*7 | 20135 | | | | | | | | | | | | | | |
| - | - | - | 7*0*1*1*0*0-0*0*4*0*2*7 | 20135 | | | | | 0 | 15.33333 | | 1 | 1 | 3 | 5 | 21.5 | | 36.833333 |
| 2 | - | 1 | 7*0*1*1*0*0-0*0*4*0*2*7 | 20135 | | 2 | | | 2 | | | | | | 0 | | | |
| - | - | 1 | 7*0*1*1*0*0-0*0*4*0*2*7 | 20135 | | | | | 0 | | | | | 3 | 3 | | | |
| - | 2 | - | 7*0*1*1*0*0-0*0*4*0*2*7 | 20135 | | | 2 | | 2 | | | | | 3 | 3 | | | |
| 2 | 2 | 2 | 7*0*1*1*0*0-0*0*4*0*2*7 | 20135 | | 2 | 2 | 1 | 5 | | | | | | 0 | | | |
| | | | | | | | | | 0 | | | | | | 0 | | | |
| 1 | 1 | 1 | 7*1*1*0*0*0-0*4*0*2*0*7 | 20410 | | | | | | | | | | | | | | |
| 2 | - | 1 | 7*1*1*0*0*0-0*4*0*2*0*7 | 20410 | | 2 | | | 2 | 9.5 | | 1 | 1 | 3 | 5 | 31.5 | | 41 |
| - | - | 1 | 7*1*1*0*0*0-0*4*0*2*0*7 | 20410 | | | | | 0 | | | | | 3 | 3 | | | |
| - | 2 | - | 7*1*1*0*0*0-0*4*0*2*0*7 | 20410 | | | 2 | | 2 | | | | | 3 | 3 | | | |
| - | - | - | 7*1*1*0*0*0-0*4*0*2*0*7 | 20410 | | | | | 0 | | | | | | 0 | | | |
| 2 | 2 | 2 | 7*1*1*0*0*0-0*4*0*2*0*7 | 20410 | | 2 | 2 | 1 | 5 | | | | | | 0 | | | |
| | | | | | | | | | 0 | | | | | | 0 | | | |
| 1 | 1 | 1 | 7*1*1*0*0*0-0*0*0*4*2*7 | 21949 | | | | | | | | | | | | | | |
| - | - | 1 | 7*1*1*0*0*0-0*0*0*4*2*7 | 21949 | | | | | 0 | 19 | | 1 | 1 | 3 | 5 | 31.5 | | 50.5 |
| - | - | 1 | 7*1*1*0*0*0-0*0*0*4*2*7 | 21949 | | | | | 0 | | | | | 3 | 3 | | | |
| 2 | - | - | 7*1*1*0*0*0-0*0*0*4*2*7 | 21949 | | 2 | | | 2 | | | | | 3 | 3 | | | |
| - | 2 | - | 7*1*1*0*0*0-0*0*0*4*2*7 | 21949 | | | 2 | | 2 | | | | | | 0 | | | |
| 2 | 2 | 2 | 7*1*1*0*0*0-0*0*0*4*2*7 | 21949 | | 2 | 2 | 1 | 5 | | | | | | 0 | | | |
| | | | | | | | | | 0 | | | | | | 0 | | | |
| 1 | 1 | 1 | 7*1*1*0*0*0-0*0*4*2*0*7 | 23048 | | | | | | | | | | | | | | |
| - | - | 1 | 7*1*1*0*0*0-0*0*4*2*0*7 | 23048 | | | | | 0 | 12.33333 | | 1 | 1 | 3 | 5 | 31.5 | | 43.833333 |
| 2 | - | 1 | 7*1*1*0*0*0-0*0*4*2*0*7 | 23048 | | 2 | | | 2 | | | | | 3 | 3 | | | |
| - | 2 | - | 7*1*1*0*0*0-0*0*4*2*0*7 | 23048 | | | 2 | | 2 | | | | | 3 | 3 | | | |
| - | - | - | 7*1*1*0*0*0-0*0*4*2*0*7 | 23048 | | | | | 0 | | | | | | 0 | | | |
| 2 | 2 | 2 | 7*1*1*0*0*0-0*0*4*2*0*7 | 23048 | | 2 | 2 | 1 | 5 | | | | | | 0 | | | |
| | | | | | | | | | 0 | | | | | | 0 | | | |
| 1 | 1 | 1 | 7*0*1*1*0*0-0*0*0*2*4*7 | 23149 | | | | | | | | | | | | | | |
| - | - | - | 7*0*1*1*0*0-0*0*0*2*4*7 | 23149 | | | | | 0 | 19 | | 1 | 1 | 3 | 5 | 21.5 | | 40.5 |
| - | - | 1 | 7*0*1*1*0*0-0*0*0*2*4*7 | 23149 | | | | | 0 | | | | | | 0 | | | |
| - | 2 | 1 | 7*0*1*1*0*0-0*0*0*2*4*7 | 23149 | | | 2 | | 2 | | | | | 3 | 3 | | | |
| 2 | - | - | 7*0*1*1*0*0-0*0*0*2*4*7 | 23149 | | 2 | | | 2 | | | | | 3 | 3 | | | |
| 2 | 2 | 2 | 7*0*1*1*0*0-0*0*0*2*4*7 | 23149 | | 2 | 2 | 1 | 5 | | | | | | 0 | | | |
| | | | | | | | | | 0 | | | | | | 0 | | | |
因为训练集B不全为0,因此网络的收敛迭代次数由列排斥能A和列排斥能B共同决定。因为把训练集A和B的位置互换,迭代次数不会有变化,因此列排斥能之间的相互作用符合交换律,这里用加法体现这种交换性。
得到列排斥能A和B的和,这里假设放缩系数c=1,
迭代次数和列排斥能的和成正比。
其中列排斥能A和B也分别都是增加的。实验表明列排斥能和迭代次数的正比或反比关系与统计方法有关
|---|---|---|---|---|---|---|-----|----------|---|---|---|---|-----|------|---|-------|
| 差值结构 || | | 构造平均列 ||| 平均列 | 列排斥能B || 构造平均列 ||| 平均列 | 列排斥能A || 排斥能的和 |
| 1 | 1 | 1 | | 2 | 2 | 1 | 5 | 12.33333 | | | | | 0 | 21.5 | | 33.83 |
| - | 2 | - | | | | | 0 | | | | | | 0 | | | |
| 2 | - | - | | | 2 | | 2 | | | | | 3 | 3 | | | |
| - | - | 1 | | 2 | | | 2 | | | | | 3 | 3 | | | |
| - | - | 1 | | | | | 0 | | | | | | 0 | | | |
| 2 | 2 | 2 | | | | | 0 | | | 1 | 1 | 3 | 5 | | | |
比如在构造平均列的时候让2在上面,1在下面,则得到数据
|----------|-------|----------|
| 列排斥能B | 列排斥能A | 列排斥能的和 |
| 12.33333 | 21.5 | 33.83333 |
| 12.33333 | 17.75 | 30.08333 |
| 9.833333 | 21.5 | 31.33333 |
| 7.333333 | 21.5 | 28.83333 |
| 9.5 | 21.5 | 31 |
| 9.5 | 17.75 | 27.25 |
| 8.333333 | 17.75 | 26.08333 |
| 8.333333 | 15.75 | 24.08333 |
| 8.333333 | 21.5 | 29.83333 |
| 12.33333 | 15.75 | 28.08333 |
| 4 | 21.5 | 25.5 |
| 9.833333 | 17.75 | 27.58333 |
| 7.333333 | 15.75 | 23.08333 |
| 7.333333 | 17.75 | 25.08333 |
| 9.5 | 15.75 | 25.25 |
| 8.5 | 15.75 | 24.25 |
| 9.833333 | 15.75 | 25.58333 |
| 8.5 | 17.75 | 26.25 |
列排斥能的和与迭代次数成反比。
并且这时列排斥能A和B也分别都是减函数。
因此不能把1和2同时放在下面或上面,那样一个是增函数一个是减函数他们的和将变得毫无规律。