[openGPS.cn] 季雨林 2017/11/5 0:32:56
最近在自己做的短网址分析网站上,通过ua信息识别到一些搜索引擎的信息,公布几个(最近一个月的数据只发现这几个):
GarlikCrawler/1.2 (http://garlik.com/, crawler@garlik.com)
185.26.92.74,
ia_archiver是alexa的一个爬虫程序,用于检测网站是否做了alexa排名的作弊
54.165.90.203,
Baiduspider/2.0
180.76.15.15,
123.125.71.85,
220.181.108.121,
180.76.15.33,
123.125.71.41,
220.181.108.117,
YisouSpider
106.11.154.195,
Googlebot/2.1
203.208.60.224,
203.208.60.223,
203.208.60.225,
203.208.60.227,
203.208.60.226,
bingbot/2.0
157.55.39.42,
40.77.167.137,
157.55.39.119,
207.46.13.16,
157.55.39.30,
40.77.167.150,
40.77.167.70,
207.46.13.133,
YandexBot/3.0
213.180.203.39,
95.108.181.114
原文地址:
https://www.opengps.cn/Blog/View.aspx?id=45
文章的更新编辑依此链接为准。欢迎关注源站原创文章!