dev.wrestling-infos.de
robots.txt

Robots Exclusion Standard data for dev.wrestling-infos.de

Resource Scan

Scan Details

Site Domain dev.wrestling-infos.de
Base Domain wrestling-infos.de
Scan Status Ok
Last Scan2025-01-06T01:42:35+00:00
Next Scan 2025-02-05T01:42:35+00:00

Last Scan

Scanned2025-01-06T01:42:35+00:00
URL https://dev.wrestling-infos.de/robots.txt
Domain IPs 195.201.215.61, 2a01:4f8:d0a:64ff::2
Response IP 195.201.215.61
Found Yes
Hash c8139a91c499b680cc6b4c0ca69b080c9d9e22b2fd5472ef96a2a2c394b314c8
SimHash 6338dc60ebb1

Groups

*

Rule Path
Disallow /v2
Disallow /w-ipediaxhfgz/

Other Records

Field Value
crawl-delay 46

ahrefsbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 200