itif.org
robots.txt

Robots Exclusion Standard data for itif.org

Resource Scan

Scan Details

Site Domain itif.org
Base Domain itif.org
Scan Status Ok
Last Scan2024-09-16T21:11:13+00:00
Next Scan 2024-10-16T21:11:13+00:00

Last Scan

Scanned2024-09-16T21:11:13+00:00
URL https://itif.org/robots.txt
Domain IPs 104.26.6.186, 104.26.7.186, 172.67.73.138, 2606:4700:20::681a:6ba, 2606:4700:20::681a:7ba, 2606:4700:20::ac43:498a
Response IP 172.67.73.138
Found Yes
Hash 9b0e2ae8887b27de7ad17071f7abc6fc771449b39c79d1f2cd7313d5c49e1858
SimHash 9804d33246e5

Groups

twitterbot

Rule Path
Disallow

ravencrawler
rogerbot
dotbot
semrushbot
semrushbot-sa
powermapper
swiftbot

Rule Path
Allow /