iheartdogs.com
robots.txt
Robots Exclusion Standard data for iheartdogs.com
Resource Scan
Scan Details
Site Domain | iheartdogs.com |
Base Domain | iheartdogs.com |
Scan Status | Failed |
Failure Stage | Fetching resource. |
Failure Reason | Server returned a client error. |
Last Scan | 2024-05-11T18:57:26+00:00 |
Next Scan | 2024-05-18T18:57:26+00:00 |
Last Successful Scan
Scanned | 2023-11-03T18:17:44+00:00 |
URL | https://iheartdogs.com/robots.txt |
Domain IPs | 104.18.10.212, 104.18.11.212, 2606:4700::6812:ad4, 2606:4700::6812:bd4 |
Response IP | 104.18.10.212 |
Found | Yes |
Hash | 6fa656d6fbe204754e625fae807fb8d4bf2ab98c57e44b0b4bdf4b0771ccf990 |
SimHash | 6504d475e335 |
Groups
*
No rules defined. All paths allowed.
Other Records
Field | Value |
---|---|
crawl-delay | 5 |