allthingsbuccaneers.com
robots.txt

Robots Exclusion Standard data for allthingsbuccaneers.com

Resource Scan

Scan Details

Site Domain allthingsbuccaneers.com
Base Domain allthingsbuccaneers.com
Scan Status Ok
Last Scan2025-07-28T21:02:49+00:00
Next Scan 2025-08-27T21:02:49+00:00

Last Scan

Scanned2025-07-28T21:02:49+00:00
URL https://allthingsbuccaneers.com/robots.txt
Domain IPs 104.21.8.82, 172.67.130.98, 2606:4700:3031::ac43:8262, 2606:4700:3033::6815:852
Response IP 104.21.8.82
Found Yes
Hash 1db7c9033ebc932a603906a47e46e9c845189dfb9e2ccb6af2568710d77ee8ea
SimHash 6857dd42ae44

Groups

*

Rule Path
Disallow /cgi-bin
Disallow /wp-admin
Disallow /wp-includes
Disallow /wp-content/plugins
Disallow /wp-content/cache
Disallow /trackback
Disallow /tag
Disallow /author
Disallow /?feed=atom
Disallow /feed
Disallow /wp-content/themes
Disallow /wp-register.php
Disallow /wp-login.php
Disallow /xmlrpc.php
Disallow /?feed=rss2
Disallow /xmlrpc.php?rsd
Disallow /?s=*
Disallow /page
Disallow /attachment
Disallow /?feed=comments-rss2
Disallow /?feed=rss
Disallow /*?utm_source*
Disallow *?utm_medium*
Disallow *?utm_content*
Disallow /*?*
Disallow /*?