bigautohandel.eu
robots.txt

Robots Exclusion Standard data for bigautohandel.eu

Resource Scan

Scan Details

Site Domain bigautohandel.eu
Base Domain bigautohandel.eu
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-09-08T18:17:10+00:00
Next Scan 2025-12-07T18:17:10+00:00

Last Successful Scan

Scanned2022-10-30T08:46:44+00:00
URL https://bigautohandel.eu/robots.txt
Redirect https://www.bigautohandel.eu/robots.txt
Redirect Domain www.bigautohandel.eu
Redirect Base bigautohandel.eu
Response IP 104.16.241.253, 104.16.240.253
Found Yes
Hash 9b0f6716154e860a9b4a9f283832188bd9653b77d10a46c0ac70d2bf508f6ee1
SimHash 65581c564091

Groups

*

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 20

Other Records

Field Value
sitemap https://www.bigautohandel.eu/sitemap.xml