autodoc24.ch
robots.txt

Robots Exclusion Standard data for autodoc24.ch

Resource Scan

Scan Details

Site Domain autodoc24.ch
Base Domain autodoc24.ch
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-06-26T15:48:36+00:00
Next Scan 2025-07-10T15:48:36+00:00

Last Successful Scan

Scanned2023-05-31T02:35:00+00:00
URL https://autodoc24.ch/robots.txt
Redirect https://www.autodoc24.ch/robots.txt
Redirect Domain www.autodoc24.ch
Redirect Base autodoc24.ch
Domain IPs 34.89.148.191
Redirect IPs 34.89.148.191
Response IP 34.89.148.191
Found Yes
Hash 1c05bbe68258a9e60561ac361a823488ac1b6c8e827c8c3eeb2a294255a55554
SimHash 4d9d5422c238

Groups

blexbot

Rule Path
Disallow /

chatgpt-user

Rule Path
Disallow /

yandex

Rule Path
Disallow /

bingbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5

*

Rule Path
Disallow /cdn-cgi/*
Disallow */aggregate
Disallow /ajax/*
Disallow *?criteria%
Disallow /register$
Disallow /profile
Disallow /profile/unsubscribe/*
Disallow /basket
Disallow /pdf/*
Disallow /search*
Disallow /*?parameter
Disallow /*?sort_supplier
Disallow /*?list=
Disallow /*?price_range
Disallow /*?gadw
Disallow /*?maker
Disallow /*?origin=1
Disallow /td_api_receiver
Disallow /p/*