icon-sets.iconify.design
robots.txt

Robots Exclusion Standard data for icon-sets.iconify.design

Resource Scan

Scan Details

Site Domain icon-sets.iconify.design
Base Domain iconify.design
Scan Status Ok
Last Scan2025-03-03T10:28:39+00:00
Next Scan 2025-04-02T10:28:39+00:00

Last Scan

Scanned2025-03-03T10:28:39+00:00
URL https://icon-sets.iconify.design/robots.txt
Domain IPs 104.26.12.204, 104.26.13.204, 172.67.71.159, 2606:4700:20::681a:ccc, 2606:4700:20::681a:dcc, 2606:4700:20::ac43:479f
Response IP 172.67.71.159
Found Yes
Hash 3607e53173d70e4eefcd7917255eb92756cadb3ef8895905fd1db8fa7850de38
SimHash c83cd4617f98

Groups

semrushbot

Rule Path
Disallow /icon-sets/*/*.html

semrushbot-sa

Rule Path
Disallow /icon-sets/*/*.html

ahrefsbot

Rule Path
Disallow /icon-sets/*/*.html

dotbot

Rule Path
Disallow /icon-sets/*/*.html

mj12bot

Rule Path
Disallow /icon-sets/*/*.html

blexbot

Rule Path
Disallow /icon-sets/*/*.html

domainstatsbot

Rule Path
Disallow /icon-sets/*/*.html

zoomspider

Rule Path
Disallow /

mauibot

Rule Path
Disallow /

megaindex.ru

Rule Path
Disallow /

megaindex.com

Rule Path
Disallow /

ltx71 - (http://ltx71.com/)

Rule Path
Disallow /