staging.therealdeal.com
robots.txt

Robots Exclusion Standard data for staging.therealdeal.com

Resource Scan

Scan Details

Site Domain staging.therealdeal.com
Base Domain therealdeal.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't connect to server.
Last Scan2025-04-18T18:06:02+00:00
Next Scan 2025-07-17T18:06:02+00:00

Last Successful Scan

Scanned2023-06-22T17:34:26+00:00
URL https://staging.therealdeal.com/robots.txt
Domain IPs 104.22.12.16, 104.22.13.16, 172.67.14.92, 2606:4700:10::6816:c10, 2606:4700:10::6816:d10, 2606:4700:10::ac43:e5c
Response IP 172.67.14.92
Found Yes
Hash 9e84c9269edc6c11fab867efc9adc3ee71445ac4f2ffb955587e30bc88bea675
SimHash e558d8f2c3b1

Groups

*

Rule Path
Disallow /

Other Records

Field Value
crawl-delay 20