craneanime.weebly.com
robots.txt

Robots Exclusion Standard data for craneanime.weebly.com

Resource Scan

Scan Details

Site Domain craneanime.weebly.com
Base Domain weebly.com
Scan Status Ok
Last Scan2024-09-28T06:04:40+00:00
Next Scan 2024-10-28T06:04:40+00:00

Last Scan

Scanned2024-09-28T06:04:40+00:00
URL https://craneanime.weebly.com/robots.txt
Domain IPs 74.115.51.8, 74.115.51.9
Response IP 74.115.51.9
Found Yes
Hash b2b010eb5e3c68e3fca25cd60ae742fb1be557bb5e27fb4171a8e3136c0086ac
SimHash a15558cc2793

Groups

nerdybot

Rule Path
Disallow /

*

Rule Path
Disallow /ajax/
Disallow /apps/
Disallow /http%3A//www.erojiji.net/index.php?%2Fforum%2F34-lounge-chat%2F
Disallow /http%3A//erojiji.net
Disallow /http%3A//www.erojiji.net/index.php?%2Ftopic%2F116-vn-index%2F

Other Records

Field Value
sitemap http://craneanime.weebly.com/sitemap.xml