iheartdogs.com
robots.txt

Robots Exclusion Standard data for iheartdogs.com

Resource Scan

Scan Details

Site Domain iheartdogs.com
Base Domain iheartdogs.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-05-11T18:57:26+00:00
Next Scan 2024-05-18T18:57:26+00:00

Last Successful Scan

Scanned2023-11-03T18:17:44+00:00
URL https://iheartdogs.com/robots.txt
Domain IPs 104.18.10.212, 104.18.11.212, 2606:4700::6812:ad4, 2606:4700::6812:bd4
Response IP 104.18.10.212
Found Yes
Hash 6fa656d6fbe204754e625fae807fb8d4bf2ab98c57e44b0b4bdf4b0771ccf990
SimHash 6504d475e335

Groups

*

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5

pinterestbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 1