autospot.ge
robots.txt

Robots Exclusion Standard data for autospot.ge

Resource Scan

Scan Details

Site Domain autospot.ge
Base Domain autospot.ge
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-08-30T11:03:05+00:00
Next Scan 2025-09-06T11:03:05+00:00

Last Successful Scan

Scanned2025-08-22T11:02:20+00:00
URL https://autospot.ge/robots.txt
Domain IPs 2a02:4780:15:9867:1e09:456:65af:1b40, 2a02:4780:38:bbc1:20c3:b28f:1554:55a1, 84.32.84.246, 84.32.84.30
Response IP 77.37.115.165
Found Yes
Hash adb2a1fa82f1ae63914c3412235fa5d272ea11046eec0501cfae03c7d553b716
SimHash 19061ce1b773

Groups

*

Rule Path
Disallow /media/
Disallow /temp/
Disallow /eng/user/
Disallow /geo/user/
Disallow /rus/user/
Disallow /hy/user/
Disallow /kk/user/
Disallow /uk/user/
Disallow /tr/user/
Disallow /uz/user/
Disallow /az/user/
Disallow /ky/user/
Disallow /templates/
Disallow /systems/ajax/cart.php
Disallow /systems/ajax/chat.php
Allow /media/images_boards/small
Allow /media/images_boards/big

ahrefsbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 1

semrushbot

Rule Path
Disallow /

megaindex

Rule Path
Disallow /

Other Records

Field Value
sitemap https://autospot.ge/sitemap.xml

Warnings

  • `clean-param` is not a known field.
  • `host` is not a known field.