segyefn.com
robots.txt
Robots Exclusion Standard data for segyefn.com
Resource Scan
Scan Details
Site Domain | segyefn.com |
Base Domain | segyefn.com |
Scan Status | Ok |
Last Scan | 2024-11-13T18:26:39+00:00 |
Next Scan | 2024-11-20T18:26:39+00:00 |
Last Scan
Scanned | 2024-11-13T18:26:39+00:00 |
URL | http://www.segyefn.com/robots.txt |
Domain IPs | 115.85.177.136, 220.230.127.225 |
Response IP | 220.230.127.225 |
Found | Yes |
Hash | 869f73bf9cf8d460112021c3f5994b50d3d047be2b37743e1412ca6f1b9c2e4c |
SimHash | 4816625270a1 |
Groups
mediapartners-google
googlebot
googlebot-news
googlebot-image
googlebot-video
facebot
twitterbot
yeti
naverbot
daumoa
bingbot
msnbot
slurp
ia_archiver
baiduspider
Rule | Path |
---|---|
Allow | / |
*
Rule | Path |
---|---|
Disallow | /log/ |
Disallow | /acecounter/ |
Disallow | /SGBoard/ |
Disallow | /config/ |
Disallow | /RSSList/ |
Disallow | /list/ |
Disallow | /newsList/ |
Disallow | /r.jsp?ai* |
Disallow | /sessionChec* |
Disallow | /content/html/ |
Disallow | /content/text/ |
Disallow | /Articles/ |
Disallow | /print/ |
Disallow | /Service5/ |
Disallow | /api/ |
Disallow | /views/include/ |
Disallow | /comment/ |
Other Records
Field | Value |
---|---|
sitemap | http://www.segye.com/Sitemap_index.xml |
Comments