亚马逊爬虫(Amazonbot)IP地址,真实采集数据

一、数据来源:

1、这批亚马逊爬虫(Amazonbot)IP来源于尚贤达猎头公司网站采集数据;

2、数据采集时间段:2023年10月-2024年7月;

3、判断标准:主要根据用户代理是否包含"Amazonbot"和IP核实。

二、亚马逊爬虫(Amazonbot)主要有4个用户代理

|----|-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------|
| 序号 | 用户代理(UserAgebt) |
| 1 | Mozilla/5.0+(Macintosh;+Intel+Mac+OS+X+10_10_1)+AppleWebKit/600.2.5+(KHTML,+like+Gecko)+Version/8.0.2+Safari/600.2.5+(Amazonbot/0.1;++https://developer.amazon.com/support/amazonbot) |
| 2 | Mozilla/5.0+(Macintosh;+Intel+Mac+OS+X+10_10_1)+AppleWebKit/600.2.5+(KHTML,+like+Gecko)+Safari/600.2.5+(Amazonbot/0.1;++https://developer.amazon.com/support/amazonbot) |
| 3 | Mozilla/5.0+(Macintosh;+Intel+Mac+OS+X+10_10_1)+AppleWebKit/600.2.5+(KHTML,+like+Gecko)+Version/8.0.2+Safari/600.2.5+(Amazonbot/0.1;++https://developer.amazon.com/support/amazonbot)+WebOne/0.12.0.0 |

三、亚马逊爬虫(Amazonbot)IP地址:

|-----------------|----------------|----------------|
| 107.180.112.120 | 172.70.34.182 | 172.71.190.94 |
| 116.202.114.170 | 172.70.34.213 | 172.71.194.75 |
| 116.202.238.183 | 172.70.34.63 | 172.71.222.147 |
| 116.202.238.184 | 172.70.34.82 | 172.71.222.167 |
| 116.202.238.188 | 172.70.35.110 | 172.71.222.236 |
| 132.148.120.131 | 172.70.35.114 | 172.71.222.48 |
| 136.0.111.243 | 172.70.35.121 | 172.71.222.66 |
| 139.162.59.178 | 172.70.35.77 | 172.71.222.84 |
| 142.171.178.55 | 172.70.35.82 | 172.71.222.87 |
| 144.217.215.90 | 172.70.38.10 | 172.71.223.166 |
| 148.135.83.86 | 172.70.38.113 | 172.71.223.17 |
| 158.69.170.92 | 172.70.38.118 | 172.71.223.185 |
| 161.97.174.214 | 172.70.38.124 | 172.71.223.28 |
| 162.0.217.123 | 172.70.38.126 | 172.71.223.35 |
| 162.158.78.102 | 172.70.38.127 | 172.71.223.36 |
| 162.158.78.32 | 172.70.38.176 | 172.71.223.63 |
| 162.158.78.64 | 172.70.38.177 | 172.71.223.77 |
| 162.158.79.167 | 172.70.38.182 | 182.50.135.77 |
| 162.158.79.183 | 172.70.38.188 | 183.157.160.84 |
| 167.99.38.231 | 172.70.38.197 | 185.165.46.140 |
| 172.105.212.14 | 172.70.38.211 | 185.50.71.199 |
| 172.70.134.120 | 172.70.38.215 | 185.57.242.32 |
| 172.70.134.122 | 172.70.38.217 | 185.57.242.41 |
| 172.70.134.130 | 172.70.38.32 | 192.3.12.183 |
| 172.70.134.146 | 172.70.39.160 | 194.233.72.170 |
| 172.70.134.212 | 172.70.39.164 | 195.201.34.52 |
| 172.70.134.47 | 172.70.39.169 | 195.90.215.186 |
| 172.70.134.90 | 172.70.39.170 | 198.2.253.78 |
| 172.70.135.225 | 172.70.39.177 | 210.158.71.88 |
| 172.70.174.112 | 172.70.39.19 | 211.62.57.46 |
| 172.70.174.15 | 172.70.39.207 | 23.101.10.141 |
| 172.70.174.171 | 172.70.39.52 | 23.22.35.162 |
| 172.70.174.186 | 172.70.42.118 | 23.224.102.175 |
| 172.70.174.254 | 172.70.42.13 | 3.224.220.101 |
| 172.70.174.26 | 172.70.42.181 | 35.163.208.129 |
| 172.70.174.29 | 172.70.42.195 | 45.32.76.94 |
| 172.70.174.80 | 172.70.42.199 | 51.79.117.220 |
| 172.70.175.122 | 172.70.42.219 | 52.70.240.171 |
| 172.70.175.124 | 172.70.42.53 | 61.160.247.8 |
| 172.70.175.127 | 172.70.42.62 | 61.164.42.140 |
| 172.70.175.18 | 172.70.42.81 | 66.96.183.55 |
| 172.70.175.200 | 172.70.42.9 | 74.208.124.146 |
| 172.70.175.201 | 172.70.42.92 | 74.208.57.233 |
| 172.70.175.215 | 172.70.43.10 | 74.208.59.24 |
| 172.70.175.54 | 172.70.43.108 | 75.87.100.223 |
| 172.70.175.89 | 172.70.43.123 | 77.48.21.22 |
| 172.70.175.93 | 172.70.43.13 | 85.10.214.210 |
| 172.70.175.94 | 172.70.43.208 | 91.134.247.202 |
| 172.70.34.143 | 172.70.43.63 | 91.134.248.245 |
| 172.70.34.172 | 172.71.190.178 | |

四、亚马逊爬虫(Amazonbot)的一些特点:

1、对网站没什么危害,但抓取网站频繁,对资源消耗较大,如果不做境外业务,可能通过防火墙阻止。

五、EXECL格式数据下载

点击进入下载页面

相关推荐
九硕智慧建筑一体化厂家5 小时前
数字化管控落地,直流照明构筑安全照明体系
运维·人工智能·笔记·安全·智慧城市
波波0076 小时前
C# 15 重磅新特性: 带标签 break 与 continue:重新定义嵌套循环控制流
服务器·前端·c#
刘某的Cloud7 小时前
ceph osd 导入导出 rbd volume 卷
linux·运维·ceph·volume
隔窗听雨眠8 小时前
GBase 8s并发控制深度解析:封锁机制、隔离级别与死锁处理全攻略
服务器·数据库·oracle
神奇霸王龙9 小时前
Agent 准入门控屠夫:5 旗舰 4 维度评估
linux·运维·数据库·ai·ai作画·agent·ai编程
鲸采云SRM采购管理系统9 小时前
采购管理系统哪家好?2026最新测评对比
java·服务器·数据库
cfm_29149 小时前
基于Binlog实现不停机数据库平滑迁移技术
运维·数据库·架构
迪康Defender10 小时前
AI 重构终端安全运营:智能分析中枢 AI Insight 模块架构与落地场景深度解析
运维·网络·人工智能·其他·安全·重构·架构
那年窗外下的雪.10 小时前
AIDC 学习日志 第 04 天 BGP Underlay 基础与路由选择
服务器·学习·php
0x5310 小时前
Java网络编程(二)
java·服务器·网络