liebespaar.de
robots.txt
Robots Exclusion Standard data for liebespaar.de
Resource Scan
Scan Details
Site Domain | liebespaar.de |
Base Domain | liebespaar.de |
Scan Status | Ok |
Last Scan | 2024-09-22T03:52:37+00:00 |
Next Scan | 2024-10-22T03:52:37+00:00 |
Last Scan
Scanned | 2024-09-22T03:52:37+00:00 |
URL | https://liebespaar.de/robots.txt |
Domain IPs | 104.26.10.196, 104.26.11.196, 172.67.74.119, 2606:4700:20::681a:ac4, 2606:4700:20::681a:bc4, 2606:4700:20::ac43:4a77 |
Response IP | 172.67.74.119 |
Found | Yes |
Hash | 2535e1cfa23aa734ee3918fcd7b9359fabb62a63cf1959a68b4b6eba44e8deb3 |
SimHash | 10584440997a |
Groups
*
No rules defined. All paths allowed.
Other Records
Field | Value |
---|---|
crawl-delay | 10 |
Warnings
- 2 invalid lines.
Comments