divebooker.com
robots.txt

Robots Exclusion Standard data for divebooker.com

Resource Scan

Scan Details

Site Domain divebooker.com
Base Domain divebooker.com
Scan Status Ok
Last Scan2025-10-16T07:24:27+00:00
Next Scan 2025-11-15T07:24:27+00:00

Last Scan

Scanned2025-10-16T07:24:27+00:00
URL https://divebooker.com/robots.txt
Domain IPs 104.26.10.237, 104.26.11.237, 172.67.72.183, 2606:4700:20::681a:aed, 2606:4700:20::681a:bed, 2606:4700:20::ac43:48b7
Response IP 104.26.10.237
Found Yes
Hash fd7bbfc3e7d11d36fb005ffd1c0e8038eb162b5dbaddd22bbe5c3cbdad21cc1b
SimHash 71856412c213

Groups

*

Rule Path
Disallow /rc/
Disallow /destinations./
Disallow /destinations/
Disallow /aquatories/
Disallow /countries/
Disallow /owner/
Disallow /profile/
Disallow /admin/
Disallow /profile
Disallow /*-hcz*
Disallow /*-gaz*
Disallow /*?f%5BisSpecial%5D=
Disallow /*-jjz*

turnitinbot

Rule Path
Disallow /boatsearch

Other Records

Field Value
sitemap https://divebooker.com/sitemap.xml
sitemap https://divebooker.com/blog/post-sitemap.xml
sitemap https://divebooker.com/blog/page-sitemap.xml
sitemap https://divebooker.com/blog/category-sitemap.xml

Warnings

  • `host` is not a known field.