菜鸟国际电子游戏首页 > 文章中心 > 正文

ip 203.208.60.* 为什么要装成google蜘蛛还是说他是真的爬虫?-电子游戏app下载


持续添加ip中

错误的爬取地址(网站)

203.208.60.1 - - [21/aug/2020:11:21:31 0800] "get /download/showdownload.php?lang=cn&id=5 http/1.1" 404 27 "-" "mozilla/5.0 (compatible; googlebot/2.1; http://www.google.com/bot.html)" "-"
203.208.60.69 - - [16/sep/2020:16:06:20 0800] "get /news/shownews.php?lang=cn&id=7 http/1.1" 404 27 "-" "mozilla/5.0 (compatible; googlebot/2.1; http://www.google.com/bot.html)" "-"
203.208.60.71 - - [21/aug/2020:13:21:49 0800] "get /job/ http/1.1" 500 9773 "-" "mozilla/5.0 (compatible; googlebot/2.1; http://www.google.com/bot.html)" "-"
203.208.60.91 - - [21/aug/2020:13:21:47 0800] "get /job/ http/1.1" 301 185 "-" "mozilla/5.0 (compatible; googlebot/2.1; http://www.google.com/bot.html)" "-"








转载请注明出处:

0

相关文章