24unterkunft.de
robots.txt

Robots Exclusion Standard data for 24unterkunft.de

Resource Scan

Scan Details

Site Domain 24unterkunft.de
Base Domain 24unterkunft.de
Scan Status Ok
Last Scan2025-04-24T02:42:57+00:00
Next Scan 2025-05-01T02:42:57+00:00

Last Scan

Scanned2025-04-24T02:42:57+00:00
URL https://24unterkunft.de/robots.txt
Domain IPs 104.21.58.173, 172.67.162.80, 2606:4700:3034::ac43:a250, 2606:4700:3035::6815:3aad
Response IP 104.21.58.173
Found Yes
Hash 9bcd2c73597097007f783d8eaca8bfe8b0f1f6dce90505cd5f67d507f66a7d9f
SimHash 4f08d852c735

Groups

*

Rule Path
Allow /

yandex

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5

Other Records

Field Value
sitemap /sitemap-categories.xml
sitemap /sitemap-objects.xml