dev.wrestling-infos.de
robots.txt
Robots Exclusion Standard data for dev.wrestling-infos.de
Resource Scan
Scan Details
Site Domain | dev.wrestling-infos.de |
Base Domain | wrestling-infos.de |
Scan Status | Ok |
Last Scan | 2025-01-06T01:42:35+00:00 |
Next Scan | 2025-02-05T01:42:35+00:00 |
Last Scan
Scanned | 2025-01-06T01:42:35+00:00 |
URL | https://dev.wrestling-infos.de/robots.txt |
Domain IPs | 195.201.215.61, 2a01:4f8:d0a:64ff::2 |
Response IP | 195.201.215.61 |
Found | Yes |
Hash | c8139a91c499b680cc6b4c0ca69b080c9d9e22b2fd5472ef96a2a2c394b314c8 |
SimHash | 6338dc60ebb1 |
Groups
*
Rule | Path |
---|---|
Disallow | /v2 |
Disallow | /w-ipediaxhfgz/ |
Other Records
Field | Value |
---|---|
crawl-delay | 46 |