help.preply.com
robots.txt

Robots Exclusion Standard data for help.preply.com

Resource Scan

Scan Details

Site Domain help.preply.com
Base Domain preply.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-08-19T13:46:45+00:00
Next Scan 2024-11-17T13:46:45+00:00

Last Successful Scan

Scanned2023-01-17T08:13:24+00:00
URL https://help.preply.com/robots.txt
Domain IPs 104.18.20.180, 104.18.21.180, 2606:4700::6812:14b4, 2606:4700::6812:15b4
Response IP 104.18.20.180
Found Yes
Hash a16efc20dc390c7f3110eb224722c798b8b4db50d98d5ea5dc8a3b08f06ccff9
SimHash 6900d862ebb0

Groups

*

Rule Path
Disallow

Other Records

Field Value
crawl-delay 1