arvutitark.ee
robots.txt

Robots Exclusion Standard data for arvutitark.ee

Resource Scan

Scan Details

Site Domain arvutitark.ee
Base Domain arvutitark.ee
Scan Status Ok
Last Scan2026-01-25T00:42:37+00:00
Next Scan 2026-02-24T00:42:37+00:00

Last Scan

Scanned2026-01-25T00:42:37+00:00
URL https://arvutitark.ee/robots.txt
Domain IPs 104.26.2.89, 104.26.3.89, 172.67.75.81, 2606:4700:20::681a:259, 2606:4700:20::681a:359, 2606:4700:20::ac43:4b51
Response IP 104.26.3.89
Found Yes
Hash 2d3c71c21f78069bd5ab612bb97b57a455cacc417b980757152b05311bd3c5f3
SimHash 390cd546ce08

Groups

*

Rule Path
Disallow /*?*
Disallow /prodpics/
Disallow /img/
Disallow /upload/

petalbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

aspiegelbot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

mauibot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

siteauditbot

Rule Path
Disallow /

semrushbot-ba

Rule Path
Disallow /

semrushbot-si

Rule Path
Disallow /

semrushbot-swa

Rule Path
Disallow /

semrushbot-ct

Rule Path
Disallow /

splitsignalbot

Rule Path
Disallow /

semrushbot-coub

Rule Path
Disallow /

Other Records

Field Value
sitemap https://cms.arvutitark.ee/sitemap/EST/index.xml