Log In Sign Up

matthewpaulturner.com
robots.txt

Robots Exclusion Standard data for matthewpaulturner.com

Resource Scan

Scan Details

Site Domain matthewpaulturner.com
Base Domain matthewpaulturner.com
Scan Status Ok
Last Scan2025-12-15T16:18:56+00:00
Next Scan 2026-01-14T16:18:56+00:00

Last Scan

Scanned2025-12-15T16:18:56+00:00
URL https://matthewpaulturner.com/robots.txt
Domain IPs 162.241.216.26
Response IP 162.241.216.26
Found Yes
Hash d87b953963c172546e02e53d785ffda5f9336b7ee604f60df48664a9aba5b4a9
SimHash 32544cc07c93

Groups

ahrefsbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

rogerbot

Rule Path
Disallow /

spbot

Rule Path
Disallow /

scoutjet

Rule Path
Disallow /

gigabot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

exabot

Rule Path
Disallow /

*

Rule Path
Disallow /wp-content/cache/
Back to top

Comments

  • spam-bots
  • BEGIN W3TC ROBOTS
  • END W3TC ROBOTS
Back to top