islanderdivers.com
robots.txt

Robots Exclusion Standard data for islanderdivers.com

Resource Scan

Scan Details

Site Domain islanderdivers.com
Base Domain islanderdivers.com
Scan Status Ok
Last Scan2025-10-02T19:55:59+00:00
Next Scan 2025-11-01T19:55:59+00:00

Last Scan

Scanned2025-10-02T19:55:59+00:00
URL http://islanderdivers.com/robots.txt
Redirect http://www.islanderdivers.com/robots.txt
Redirect Domain www.islanderdivers.com
Redirect Base islanderdivers.com
Domain IPs 199.34.228.79
Redirect IPs 199.34.228.79
Response IP 199.34.228.79
Found Yes
Hash 440175be85b02e82c2f7ab34e84015a5fadda95d59dd902273b20189f364438f
SimHash 3355dce00b93

Groups

nerdybot

Rule Path
Disallow /

*

Rule Path
Disallow /ajax/
Disallow /apps/
Disallow /https%3A//www.instagram.com/su_huai/
Disallow /https%3A//www.youtube.com/channel/UC7yl6NwazPZDvCw3XIOlGeA
Disallow /http%3A//islanderdivers.weebly.com

Other Records

Field Value
sitemap http://www.islanderdivers.com/sitemap.xml