autounioninc.com
robots.txt

Robots Exclusion Standard data for autounioninc.com

Resource Scan

Scan Details

Site Domain autounioninc.com
Base Domain autounioninc.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-07-11T15:00:18+00:00
Next Scan 2024-10-09T15:00:18+00:00

Last Successful Scan

Scanned2022-11-26T15:16:52+00:00
URL https://autounioninc.com/robots.txt
Response IP 128.136.151.27
Found Yes
Hash dc9ba19bc61bbc6fb37f924e5ecd7483d49c28f06917b2cbd60b4f7f8f418e0b
SimHash 085c534277b0

Groups

mj12bot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

semrushbot/6~bl

Rule Path
Disallow /

ahrefsbot/6.1

Rule Path
Disallow /

megaindex.ru/2.0

Rule Path
Disallow /

python-requests/2.22.0

Rule Path
Disallow /

blexbot/1.0

Rule Path
Disallow /

*

Rule Path
Allow /