segyefn.com
robots.txt

Robots Exclusion Standard data for segyefn.com

Resource Scan

Scan Details

Site Domain segyefn.com
Base Domain segyefn.com
Scan Status Ok
Last Scan2024-11-13T18:26:39+00:00
Next Scan 2024-11-20T18:26:39+00:00

Last Scan

Scanned2024-11-13T18:26:39+00:00
URL http://www.segyefn.com/robots.txt
Domain IPs 115.85.177.136, 220.230.127.225
Response IP 220.230.127.225
Found Yes
Hash 869f73bf9cf8d460112021c3f5994b50d3d047be2b37743e1412ca6f1b9c2e4c
SimHash 4816625270a1

Groups

mediapartners-google
googlebot
googlebot-news
googlebot-image
googlebot-video
facebot
twitterbot
yeti
naverbot
daumoa
bingbot
msnbot
slurp
ia_archiver
baiduspider

Rule Path
Allow /

*

Rule Path
Disallow /log/
Disallow /acecounter/
Disallow /SGBoard/
Disallow /config/
Disallow /RSSList/
Disallow /list/
Disallow /newsList/
Disallow /r.jsp?ai*
Disallow /sessionChec*
Disallow /content/html/
Disallow /content/text/
Disallow /Articles/
Disallow /print/
Disallow /Service5/
Disallow /api/
Disallow /views/include/
Disallow /comment/

Other Records

Field Value
sitemap http://www.segye.com/Sitemap_index.xml

Comments

  • WebApp