whatyoucanread.com
robots.txt

Robots Exclusion Standard data for whatyoucanread.com

Resource Scan

Scan Details

Site Domain whatyoucanread.com
Base Domain whatyoucanread.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a server error.
Last Scan2024-10-21T13:50:25+00:00
Next Scan 2024-11-20T13:50:25+00:00

Last Successful Scan

Scanned2024-09-22T13:49:38+00:00
URL https://whatyoucanread.com/robots.txt
Domain IPs 104.21.94.195, 172.67.168.162, 2606:4700:3031::6815:5ec3, 2606:4700:3035::ac43:a8a2
Response IP 104.21.94.195
Found Yes
Hash 005f93d8900b33c8ba223c453b53bd486bee225b646a663b2c9a6facc404e365
SimHash 6514c6504b52

Groups

*

Rule Path
Disallow /search
Disallow /url
Disallow /proxy