worldwideboat.com
robots.txt

Robots Exclusion Standard data for worldwideboat.com

Resource Scan

Scan Details

Site Domain worldwideboat.com
Base Domain worldwideboat.com
Scan Status Ok
Last Scan2025-03-20T03:31:42+00:00
Next Scan 2025-04-19T03:31:42+00:00

Last Scan

Scanned2025-03-20T03:31:42+00:00
URL https://worldwideboat.com/robots.txt
Redirect https://www.worldwideboat.com/robots.txt
Redirect Domain www.worldwideboat.com
Redirect Base worldwideboat.com
Domain IPs 34.174.164.237
Redirect IPs 104.21.39.108, 172.67.144.145, 2606:4700:3033::ac43:9091, 2606:4700:3034::6815:276c
Response IP 104.21.39.108
Found Yes
Hash 5a83e71ffa3a51d0c7bb8bb80de3a01273f40ad287d247a29abb8c44f184a574
SimHash 24615f536606

Groups

*

Rule Path
Disallow /Database-Backup
Disallow /broadcast
Disallow /cgi-bin
Disallow /wp-admin
Disallow /wp-includes
Disallow /wp-snapshots
Disallow /*/?*

Other Records

Field Value
crawl-delay 10

Other Records

Field Value
sitemap https://www.worldwideboat.com/sitemap_index.xml

Comments

  • updated on 06 August 2018
  • Allow crawling of all content