autoextremist.com
robots.txt

Robots Exclusion Standard data for autoextremist.com

Resource Scan

Scan Details

Site Domain autoextremist.com
Base Domain autoextremist.com
Scan Status Ok
Last Scan2025-10-03T02:32:38+00:00
Next Scan 2025-11-02T02:32:38+00:00

Last Scan

Scanned2025-10-03T02:32:38+00:00
URL https://autoextremist.com/robots.txt
Redirect https://www.autoextremist.com/robots.txt
Redirect Domain www.autoextremist.com
Redirect Base autoextremist.com
Domain IPs 198.185.159.160, 198.185.159.161, 198.49.23.160, 198.49.23.161
Redirect IPs 198.185.159.160, 198.185.159.161, 198.49.23.160, 198.49.23.161
Response IP 198.49.23.161
Found Yes
Hash c4d19f1b913088738d2697e9328e2e179c16b8a959762fd593c4de6eae51ccce
SimHash 38527762af4f

Groups

*

Rule Path
Disallow /display/admin/
Disallow /display/Search
Disallow /display/Login
Disallow /display/RecoverPassword
Disallow /login
Disallow /contributor
Disallow /current/category
Disallow /current/week
Disallow /current/month
Disallow /current/recommend
Disallow /current/author
Disallow /login
Disallow /search-autoextremist
Disallow /contact-ae
Disallow /on-the-table1/category
Disallow /on-the-table1/week
Disallow /on-the-table1/month
Disallow /on-the-table1/recommend
Disallow /on-the-table1/author
Disallow /the-line1/category
Disallow /the-line1/week
Disallow /the-line1/month
Disallow /the-line1/recommend
Disallow /the-line1/author
Disallow /fumes1/category
Disallow /fumes1/week
Disallow /fumes1/month
Disallow /fumes1/recommend
Disallow /fumes1/author

Comments

  • Squarespace Standard Robot Exclusion
  • Access is disallowed to functional / filtering URLs