dailysignal.org
robots.txt

Robots Exclusion Standard data for dailysignal.org

Resource Scan

Scan Details

Site Domain dailysignal.org
Base Domain dailysignal.org
Scan Status Ok
Last Scan2024-11-16T18:31:07+00:00
Next Scan 2024-11-23T18:31:07+00:00

Last Scan

Scanned2024-11-16T18:31:07+00:00
URL https://dailysignal.org/robots.txt
Redirect https://www.dailysignal.com/robots.txt
Redirect Domain www.dailysignal.com
Redirect Base dailysignal.com
Domain IPs 23.185.0.3, 2620:12a:8000::3, 2620:12a:8001::3
Redirect IPs 104.22.12.28, 104.22.13.28, 172.67.29.191, 2606:4700:10::6816:c1c, 2606:4700:10::6816:d1c, 2606:4700:10::ac43:1dbf
Response IP 104.22.12.28
Found Yes
Hash 447c71bcc30383579c1a3df1cfb3bc338afbc24d010315ceb221c2e0a976810f
SimHash a81ca343e7f0

Groups

*

Rule Path
Allow /
Disallow /print

bitlybot

Rule Path
Disallow /

Comments

  • Tell "bitlybot" not to come here at all