metrac.org
robots.txt

Robots Exclusion Standard data for metrac.org

Resource Scan

Scan Details

Site Domain metrac.org
Base Domain metrac.org
Scan Status Ok
Last Scan2025-09-25T23:21:27+00:00
Next Scan 2025-10-25T23:21:27+00:00

Last Scan

Scanned2025-09-25T23:21:27+00:00
URL https://metrac.org/robots.txt
Domain IPs 104.21.46.95, 172.67.137.85, 2606:4700:3032::6815:2e5f, 2606:4700:3033::ac43:8955
Response IP 104.21.46.95
Found Yes
Hash 5b83bcf800425ad704b86a343ddfe040c1e541ce21ef4aae9bc56bdf9c5effac
SimHash 1c10f506f940

Groups

yandexbot

Rule Path
Disallow /

yandex

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

siteauditbot

Rule Path
Disallow /

semrushbot-ba

Rule Path
Disallow /

semrushbot-si

Rule Path
Disallow /

semrushbot-swa

Rule Path
Disallow /

semrushbot-ct

Rule Path
Disallow /

semrushbot-bm

Rule Path
Disallow /

splitsignalbot

Rule Path
Disallow /

semrushbot-coub

Rule Path
Disallow /