记录蜘蛛爬行ASP代码
先建立一个 robots 文件夹
0 {! W, l4 J0 k% F
1 {4 f5 C) p: R1 o- ]" ^4 C; P7 x, O
<% , A7 r6 r7 r0 a* `: \/ B5 r1 s
Sub robot()
6 K. L1 Q; l( V, A; rDim robots:robots="Baiduspider+@Baidu|Googlebot@Google|ia_archiver@Alexa|IAArchiver@Alexa|ASPSeek@ASPSeek|YahooSeeker@Yahoo|sohu-search@Sohu|help.yahoo.com/help/us/ysearch/slurp@Yahoo|sohu-search@SOHU|MSNBOT@MSN"
W8 d- z6 Q0 v0 Odim I1,I2,l1,l2,l3,i,rs 3 R2 X6 \: N+ t& p& M5 H
l2=false
( _% I8 J) `. I6 Z+ A& _$ f0 f; Il1=request.servervariables("http_user_agent") ) V& j! J& I: ~; h) Q: v0 f
F1=request.ServerVariables("[size=+0]script_NAME") 5 c; j# M: `9 [& z
I1=split(robots,chr(124)) 4 ]4 v! R Y/ |" S1 G! h3 D7 o
for i=0 to ubound(I1)
2 q! \5 Y4 A- m; E+ O2 TI2=split(I1(i),"@")
4 q& K8 |" p- t' Rif instr(lcase(l1),lcase(I2(0)))>0 then 9 E, U' W/ N1 S0 o, {4 }
l2=true:l3=I2(1):exit for
' R8 l' B, O) O+ W$ jend if
3 Y- O4 t, N; h5 ^' t$ U2 jnext
) G. F, J: G, m! y* f4 |, ]if l2 and len(l3)>0 then'如果是爬虫,就更新爬虫信息 {/ x; k( @2 P% I5 u! V
FilePath = Server.Mappath("robots/"&l3&"_robots.txt")
! {4 y" S9 N& q- ~/ e8 z'记录蜘蛛爬行
1 J3 L, Q! Z8 ]% m- V/ |, kSet Fso = Server.CreateObject("[size=+0]scripting.FileSystemObject") 1 W; ~5 i7 ~! N
Set Fout = Fso.OpenTextFile(FilePath,8,True) : a+ N- X0 x/ n7 J" y
Fout.WriteLine "索引页面："&F1 ) T6 s, b3 q9 q6 y* Y# G
Fout.WriteLine "蜘蛛："&l3&chr(32)&chr(32)&"更新时间："&**()
" q2 q" u8 u- r1 }! h- l* P( cFout.WriteLine "-----------------------------------------------" " ?; `( \: {( m' ~4 i( M/ ]
Fout.Close
" I/ z; ~4 W$ t/ qSet Fout = Nothing & y1 H* \" H0 p7 O+ i
Set Fso = Nothing
) C# y& [6 V% Cend if
; H# J% o- C9 S) Jend Sub
* `6 `) C4 [ x/ E+ k0 r1 y" o. i%>
. P: `( P8 Z: W/ fasp 放在公用的函数文件里面 ' t* j/ W+ H$ e: C+ Y5 _
比如 放在conn.asp里面 然后直接在 下面调用过程就行了 & L/ \2 X3 ?3 p: y
* u8 R V8 l0 ?: |9 a. [' YCall robot()
搜索更多相关主题的帖子:
百度 蜘蛛 日志
