asyura2.com
robots.txt

Robots Exclusion Standard data for asyura2.com

Resource Scan

Scan Details

Site Domain asyura2.com
Base Domain asyura2.com
Scan Status Ok
Last Scan2024-11-04T19:49:02+00:00
Next Scan 2024-11-11T19:49:02+00:00

Last Scan

Scanned2024-11-04T19:49:02+00:00
URL http://asyura2.com/robots.txt
Redirect http://www.asyura2.com/robots.txt
Redirect Domain www.asyura2.com
Redirect Base asyura2.com
Domain IPs 148.72.167.245
Redirect IPs 148.72.167.245
Response IP 148.72.167.245
Found Yes
Hash 5aaa3de4f5f938c6d9c6018593f75f31bab39f3e17cbce5b88f827718521b7fc
SimHash a9346a04695a

Groups

*

Rule Path
Disallow /*.cgi
Disallow /*.php
Disallow /bbsup/
Disallow /*.html?