uag.com
robots.txt

Robots Exclusion Standard data for uag.com

Resource Scan

Scan Details

Site Domain uag.com
Base Domain uag.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-04-19T06:36:51+00:00
Next Scan 2025-04-26T06:36:51+00:00

Last Successful Scan

Scanned2025-03-19T06:04:50+00:00
URL https://uag.com/robots.txt
Redirect https://www.penskeautomotive.com/robots.txt
Redirect Domain www.penskeautomotive.com
Redirect Base penskeautomotive.com
Domain IPs 184.87.193.137, 184.87.193.150, 2600:1413:b000:13::b857:c189, 2600:1413:b000:13::b857:c196
Redirect IPs 104.18.22.16, 104.18.23.16, 2606:4700::6812:1610, 2606:4700::6812:1710
Response IP 104.18.22.16
Found Yes
Hash 741f5a0738df28d6c19625b24c124c6426df816c2855202af19caf37152c14b1
SimHash 690540544d93

Groups

*

Rule Path
Disallow /user_area/

Other Records

Field Value
sitemap https://www.penskeautomotive.com/sitemap.xmlSitemap: https://www.penskeautomotive.com/sitemap-cars.xml