autonobile.pl
robots.txt

Robots Exclusion Standard data for autonobile.pl

Resource Scan

Scan Details

Site Domain autonobile.pl
Base Domain autonobile.pl
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-09-10T12:53:09+00:00
Next Scan 2025-12-09T12:53:09+00:00

Last Successful Scan

Scanned2022-11-01T04:50:47+00:00
URL https://www.autonobile.pl/robots.txt
Response IP 104.16.240.253, 104.16.241.253
Found Yes
Hash b0521c49cb88aaf8420410e5316a38e6b2a342e8dc8a1ad00e94653e0f39d83c
SimHash 65085cd5c491

Groups

*

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 20

Other Records

Field Value
sitemap https://www.autonobile.pl/sitemap.xml