brentdetwiler.com
robots.txt

Robots Exclusion Standard data for brentdetwiler.com

Resource Scan

Scan Details

Site Domain brentdetwiler.com
Base Domain brentdetwiler.com
Scan Status Ok
Last Scan2024-06-17T10:33:29+00:00
Next Scan 2024-07-17T10:33:29+00:00

Last Scan

Scanned2024-06-17T10:33:29+00:00
URL http://brentdetwiler.com/robots.txt
Redirect http://www.brentdetwiler.com/robots.txt
Redirect Domain www.brentdetwiler.com
Redirect Base brentdetwiler.com
Domain IPs 65.39.205.54
Redirect IPs 198.185.159.176, 198.185.159.177, 198.49.23.176, 198.49.23.177
Response IP 198.185.159.177
Found Yes
Hash 4bc2eeddb55e1e135f3525c5e1cbb199692e76a5f5a249c1c71e11a4af686a74
SimHash 3c117562efdf

Groups

*

Rule Path
Disallow /display/admin/
Disallow /display/Search
Disallow /display/Login
Disallow /display/RecoverPassword
Disallow /login
Disallow /contributor
Disallow /brentdetwilercom/category
Disallow /brentdetwilercom/week
Disallow /brentdetwilercom/month
Disallow /brentdetwilercom/recommend
Disallow /brentdetwilercom/author
Disallow /sb-gpstdnxi

Comments

  • Squarespace Standard Robot Exclusion
  • Access is disallowed to functional / filtering URLs