dailysignal.com
robots.txt

Robots Exclusion Standard data for dailysignal.com

Resource Scan

Scan Details

Site Domain dailysignal.com
Base Domain dailysignal.com
Scan Status Ok
Last Scan2024-11-13T11:54:16+00:00
Next Scan 2024-11-20T11:54:16+00:00

Last Scan

Scanned2024-11-13T11:54:16+00:00
URL https://dailysignal.com/robots.txt
Redirect https://www.dailysignal.com/robots.txt
Redirect Domain www.dailysignal.com
Redirect Base dailysignal.com
Domain IPs 104.22.12.28, 104.22.13.28, 172.67.29.191, 2606:4700:10::6816:c1c, 2606:4700:10::6816:d1c, 2606:4700:10::ac43:1dbf
Redirect IPs 104.22.12.28, 104.22.13.28, 172.67.29.191, 2606:4700:10::6816:c1c, 2606:4700:10::6816:d1c, 2606:4700:10::ac43:1dbf
Response IP 104.22.12.28
Found Yes
Hash 447c71bcc30383579c1a3df1cfb3bc338afbc24d010315ceb221c2e0a976810f
SimHash a81ca343e7f0

Groups

*

Rule Path
Allow /
Disallow /print

bitlybot

Rule Path
Disallow /

Comments

  • Tell "bitlybot" not to come here at all