autoguide.com
robots.txt

Robots Exclusion Standard data for autoguide.com

Resource Scan

Scan Details

Site Domain autoguide.com
Base Domain autoguide.com
Scan Status Ok
Last Scan2024-04-26T11:23:48+00:00
Next Scan 2024-05-03T11:23:48+00:00

Last Scan

Scanned2024-04-26T11:23:48+00:00
URL https://autoguide.com/robots.txt
Redirect https://www.autoguide.com/robots.txt
Redirect Domain www.autoguide.com
Redirect Base autoguide.com
Domain IPs 108.61.152.35, 45.77.153.86
Redirect IPs 151.101.1.91, 151.101.129.91, 151.101.193.91, 151.101.65.91, 2a04:4e42:200::347, 2a04:4e42:400::347, 2a04:4e42:600::347, 2a04:4e42::347
Response IP 199.232.45.91
Found Yes
Hash 252525b40356d48c28fa02425c0a0dd8c3f4bbc3b121853037b18f59754b61da
SimHash 1b0e8210d6b2

Groups

mediapartners-google

Rule Path
Allow /

*

Rule Path
Disallow /?*activity_id=*
Disallow /ajax/
Disallow /tour/
Disallow /browser
Disallow /delete
Disallow /sharebox
Disallow /account
Disallow /flag
Disallow /logging/
Disallow /track_ht/
Disallow /js/errors
Disallow /homemade
Disallow /comment
Disallow /hashtags
Disallow /outdated
Disallow /board
Disallow /notifications
Disallow /paid-acquisition
Disallow /rapid
Disallow /react
Disallow *size%3D
Disallow *sort%3D
Disallow *se%3D
Disallow *%3B
Disallow *force_refresh%3D
Disallow *split_test%3D
Disallow /l/

Other Records

Field Value
sitemap https://www.autoguide.com/rfs/sitemaps/autoguide.sitemootx.xml