tm.de
robots.txt

Robots Exclusion Standard data for tm.de

Resource Scan

Scan Details

Site Domain tm.de
Base Domain tm.de
Scan Status Ok
Last Scan2024-09-20T21:07:27+00:00
Next Scan 2024-09-27T21:07:27+00:00

Last Scan

Scanned2024-09-20T21:07:27+00:00
URL https://tm.de/robots.txt
Redirect https://www.transfermarkt.de/robots.txt
Redirect Domain www.transfermarkt.de
Redirect Base transfermarkt.de
Domain IPs 5.159.57.194, 5.159.57.195
Redirect IPs 18.165.183.26, 18.165.183.34, 18.165.183.72, 18.165.183.79, 2600:9000:2024:1200:2:ab4f:7280:93a1, 2600:9000:2024:3400:2:ab4f:7280:93a1, 2600:9000:2024:400:2:ab4f:7280:93a1, 2600:9000:2024:5e00:2:ab4f:7280:93a1, 2600:9000:2024:6e00:2:ab4f:7280:93a1, 2600:9000:2024:8800:2:ab4f:7280:93a1, 2600:9000:2024:c400:2:ab4f:7280:93a1, 2600:9000:2024:da00:2:ab4f:7280:93a1
Response IP 52.85.49.47
Found Yes
Hash 9fd22887e9239d1a35054a5fb86763554940ebd951ce9e4ecc8d10a86eada5f9
SimHash 4542d6304715

Groups

slurp

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 2

mediapartners-google

Rule Path
Disallow

wget

Rule Path
Disallow /

*

Rule Path
Allow /