ivarch.com
robots.txt

Robots Exclusion Standard data for ivarch.com

Resource Scan

Scan Details

Site Domain ivarch.com
Base Domain ivarch.com
Scan Status Ok
Last Scan2025-11-29T02:02:06+00:00
Next Scan 2025-12-13T02:02:06+00:00

Last Scan

Scanned2025-11-29T02:02:06+00:00
URL https://ivarch.com/robots.txt
Domain IPs 161.35.47.56
Response IP 161.35.47.56
Found Yes
Hash ddb9b1a11973b7eb85c3262cdcd982bddbf91c3f96fd823113c207d1218db824
SimHash b11d0808db04

Groups

ia_archiver

Rule Path
Disallow /

psbot

Rule Path
Disallow /

quepasacreep

Rule Path
Disallow /

npbot

Rule Path
Disallow /

dtaagent

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

imagesiftbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

*

Rule Path
Disallow /scripts
Disallow /oops-2.4.17-rc1
Disallow /stats
Disallow /me/cv.shtml
Disallow /personal/cv.shtml
Disallow /rfs.shtml
Disallow /services/stats
Disallow /services/user
Disallow /mobile
Disallow /webmail
Disallow /programs/binaries
Disallow /programs/rpms