youdateme.com
robots.txt
Robots Exclusion Standard data for youdateme.com
Resource Scan
Scan Details
Site Domain | youdateme.com |
Base Domain | youdateme.com |
Scan Status | Failed |
Failure Reason | Scan timed out. |
Last Scan | 2024-08-02T17:37:52+00:00 |
Next Scan | 2024-10-31T17:37:52+00:00 |
Last Successful Scan
Scanned | 2023-12-01T11:49:38+00:00 |
URL | https://youdateme.com/robots.txt |
Domain IPs | 192.185.183.177 |
Response IP | 192.185.183.177 |
Found | Yes |
Hash | 2535e1cfa23aa734ee3918fcd7b9359fabb62a63cf1959a68b4b6eba44e8deb3 |
SimHash | 10584440997a |
Groups
*
No rules defined. All paths allowed.
Other Records
Field | Value |
---|---|
crawl-delay | 10 |
Warnings
- 2 invalid lines.
Comments