 |    |
■ 検索ロボット様を歓迎する方法検索ロボット様はＪＡＶＡスクリプトをご覧にならないのです。 画像さえも横目で通り過ぎるので、imgから呼び出しているcgiも無力です。 で、SSIからcgiを呼び出して解析します。解析の中で、$HTTP_USER_AGENTをしらべ、人間の使う野蛮な ブラウザを除いて記録していきます。 ■ 排除している USER_AGENTMSIE 当然ですよねNetscape InternetSeer サーバーの稼動モニターしてくれるのはありがたいが・・ ■ 検索ロボット様 最近のご来訪記録2008/05/9 13:03(GMT)CCBot/1.0 (+http://www.commoncrawl.org/bot.html) 2008/05/9 00:18(GMT) Mozilla/5.0 (compatible; Yahoo! Slurp/3.0; http://help.yahoo.com/help/us/ysearch/slurp) 2008/05/8 17:51(GMT) Baiduspider+(+http://www.baidu.com/search/spider_jp.html) 2008/05/8 07:07(GMT) DoCoMo/1.0/N505i/c20/TB/W20H10 (compatible; Googlebot-Mobile/2.1; +http://www.google.com/bot.html) 2008/05/8 05:25(GMT) WebAlta Crawler/2.0 (http://www.webalta.net/ru/about_webmaster.html) (Windows; U; Windows NT 5.1; ru-RU) 2008/05/8 02:33(GMT) Baiduspider+(+http://www.baidu.com/search/spider_jp.html) 2008/05/8 02:14(GMT) Yeti/1.0 (+http://help.naver.com/robots/) 2008/05/7 22:45(GMT) User-Agent: Mozilla/4.07 [ja_JP.EUC] (X11; I; MarkAgent FreeBSD 2.2.8-RELEASE i386; Nav) 2008/05/7 19:44(GMT) Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html) 2008/05/7 03:47(GMT) WebAlta Crawler/2.0 (http://www.webalta.net/ru/about_webmaster.html) (Windows; U; Windows NT 5.1; ru-RU) 2008/05/6 17:34(GMT) Mozilla/4.0+(compatible;) 2008/05/6 17:00(GMT) Baiduspider+(+http://www.baidu.com/search/spider_jp.html) 2008/05/6 12:08(GMT) Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp) 2008/05/6 09:53(GMT) Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp) 2008/05/6 08:21(GMT) Baiduspider+(+http://www.baidu.com/search/spider_jp.html) 2008/05/6 01:34(GMT) Baiduspider+(+http://www.baidu.com/search/spider_jp.html) 2008/05/6 01:21(GMT) Mozilla/5.0 (compatible; Yahoo! Slurp China; http://misc.yahoo.com.cn/help.html) 2008/05/5 21:13(GMT) SurveyBot/2.3 (Whois Source) 2008/05/5 15:40(GMT) TurnitinBot/2.1 (http://www.turnitin.com/robot/crawlerinfo.html) 2008/05/5 15:37(GMT) TurnitinBot/2.1 (http://www.turnitin.com/robot/crawlerinfo.html) 2008/05/5 01:31(GMT) User-Agent: Mozilla/4.07 [ja_JP.EUC] (X11; I; MarkAgent FreeBSD 2.2.8-RELEASE i386; Nav) 2008/05/4 22:57(GMT) 2008/05/4 15:33(GMT) Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html) 2008/05/3 23:37(GMT) msnbot/1.1 (+http://search.msn.com/msnbot.htm) 2008/05/3 12:01(GMT) Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp) 2008/05/3 10:27(GMT) ia_archiver 2008/05/3 09:50(GMT) Baiduspider+(+http://www.baidu.com/search/spider_jp.html) 2008/05/3 08:37(GMT) Python-urllib/1.15 2008/05/3 07:53(GMT) msnbot/1.1 (+http://search.msn.com/msnbot.htm) 2008/05/3 02:35(GMT) Baiduspider+(+http://www.baidu.com/search/spider_jp.html) 2008/05/2 06:13(GMT) Mozilla/5.0 (compatible; DiffBrowser/0.88; Windows) 2008/05/2 02:54(GMT) User-Agent: Mozilla/4.07 [ja_JP.EUC] (X11; I; MarkAgent FreeBSD 2.2.8-RELEASE i386; Nav) 2008/05/2 01:21(GMT) msnbot/1.1 (+http://search.msn.com/msnbot.htm) 2008/05/1 11:50(GMT) Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp) 2008/05/1 08:20(GMT) Mozilla/5.0 (compatible; Yahoo! Slurp China; http://misc.yahoo.com.cn/help.html) 2008/05/1 05:51(GMT) Baiduspider+(+http://www.baidu.com/search/spider_jp.html) 2008/05/1 05:12(GMT) Opera/8.00 (Windows NT 5.1; U; en) 2008/05/1 02:28(GMT) Baiduspider+(+http://www.baidu.com/search/spider_jp.html) 2008/04/30 23:11(GMT) Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html) 2008/04/30 21:00(GMT) Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp) 2008/04/30 13:46(GMT) Mozilla/5.0 (compatible; YodaoBot/1.0; http://www.yodao.com/help/webmaster/spider/; ) 2008/04/30 10:12(GMT) Mozilla/5.0 (compatible; YodaoBot/1.0; http://www.yodao.com/help/webmaster/spider/; ) 2008/04/30 10:02(GMT) Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp) 2008/04/30 07:53(GMT) Mozilla/5.0 (compatible; YodaoBot/1.0; http://www.yodao.com/help/webmaster/spider/; ) 2008/04/30 07:11(GMT) Mozilla/5.0 (compatible; YodaoBot/1.0; http://www.yodao.com/help/webmaster/spider/; ) 2008/04/30 05:32(GMT) Mozilla/5.0 (compatible; YodaoBot/1.0; http://www.yodao.com/help/webmaster/spider/; ) 2008/04/30 03:06(GMT) Mozilla/5.0 (compatible; YodaoBot/1.0; http://www.yodao.com/help/webmaster/spider/; ) 2008/04/30 00:51(GMT) Mozilla/5.0 (compatible; YodaoBot/1.0; http://www.yodao.com/help/webmaster/spider/; ) 2008/04/29 23:30(GMT) boitho.com-dc/0.85 ( http://www.boitho.com/dcbot.html ) 2008/04/29 10:00(GMT) Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp) | |
|
| |
| |