automotiveit.com
robots.txt

Robots Exclusion Standard data for automotiveit.com

Resource Scan

Scan Details

Site Domain automotiveit.com
Base Domain automotiveit.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't establish SSL connection.
Last Scan2025-10-03T15:26:18+00:00
Next Scan 2025-10-17T15:26:18+00:00

Last Successful Scan

Scanned2025-08-25T23:22:52+00:00
URL https://automotiveit.com/robots.txt
Redirect https://www.automotiveit.com:443/robots.txt
Redirect Domain www.automotiveit.com
Redirect Base automotiveit.com
Domain IPs 52.223.11.33
Redirect IPs 35.71.136.153, 52.223.11.33
Response IP 35.71.136.153
Found Yes
Hash fa80a3bffe663cc25ee23245d61fb9277319c19007ab00c414d01027c5680151
SimHash e70d02031d16

Groups

*

Rule Path
Disallow /register$
Disallow /searchresults
Disallow /solrsearchresults
Disallow /sign-out
Disallow /sign-in
Disallow /attachment$
Disallow /reporttomoderator
Disallow /download$
Disallow /forgotten-password
Disallow /my-account/*
Disallow /my-account
Disallow /*.publicprofile
Disallow /ajax/*
Disallow /api/*
Disallow /mysaved
Disallow /bookmark$
Disallow /*?userid=
Disallow /*?uc=
Disallow /sitedashboard/*
Disallow /swagger/*
Disallow /CookiePolicy.aspx
Disallow /SystemCheck.aspx
Disallow /Attachments_Advert.aspx
Disallow /navsectionFullRSS.aspx
Disallow /*.fullrss
Disallow /navsectionRSS.aspx
Disallow /*.rss

Other Records

Field Value
sitemap https://www.automotiveit.com/GoogleSiteMapIndex.aspx