getthedata.com
robots.txt

Robots Exclusion Standard data for getthedata.com

Resource Scan

Scan Details

Site Domain getthedata.com
Base Domain getthedata.com
Scan Status Ok
Last Scan2024-05-16T21:41:13+00:00
Next Scan 2024-05-23T21:41:13+00:00

Last Scan

Scanned2024-05-16T21:41:13+00:00
URL https://getthedata.com/robots.txt
Redirect https://www.getthedata.com/robots.txt
Redirect Domain www.getthedata.com
Redirect Base getthedata.com
Domain IPs 104.21.56.181, 172.67.155.69, 2606:4700:3033::ac43:9b45, 2606:4700:3036::6815:38b5
Redirect IPs 104.21.56.181, 172.67.155.69, 2606:4700:3033::ac43:9b45, 2606:4700:3036::6815:38b5
Response IP 172.67.155.69
Found Yes
Hash 7edffef505a67e5158ccce6677ec865b0a06511a674688938ac76c8410910b02
SimHash d115d444cb13

Groups

*

Rule Path
Disallow /downloads/