Log In Sign Up

automotolife.com
robots.txt

Robots Exclusion Standard data for automotolife.com

Resource Scan

Scan Details

Site Domain automotolife.com
Base Domain automotolife.com
Scan Status Ok
Last Scan2026-04-03T01:55:23+00:00
Next Scan 2026-04-10T01:55:23+00:00

Last Scan

Scanned2026-04-03T01:55:23+00:00
URL https://automotolife.com/robots.txt
Domain IPs 104.21.96.93, 172.67.176.71, 2606:4700:3031::ac43:b047, 2606:4700:3033::6815:605d
Response IP 104.21.96.93
Found Yes
Hash 7c306e1d3fee5fb207ea6a2c1fd91f33cb82a3a1c47b0fb8f8ed6ed22544dfc7
SimHash e48ace8145ba

Groups

lumen*

Rule Path
Disallow /

lumenapi*

Rule Path
Disallow /

dmcabot*

Rule Path
Disallow /

dmca*

Rule Path
Disallow /

legal*

Rule Path
Disallow /

chillingeffects*

Rule Path
Disallow /

copyscape*

Rule Path
Disallow /

plagiarismbot*

Rule Path
Disallow /

dmcachecker*

Rule Path
Disallow /

copyrightbot*

Rule Path
Disallow /

antipiracybot*

Rule Path
Disallow /

googlebot

Rule Path
Allow /

bingbot

Rule Path
Allow /

yahoo! slurp

Rule Path
Allow /

duckduckbot

Rule Path
Allow /

baiduspider

Rule Path
Allow /

*

Rule Path
Allow /
Back to top

Other Records

Field Value
sitemap https://automotolife.com/sitemap.xml
Back to top

Warnings

  • 6 invalid lines.
Back to top