ilimdunyasi.com
robots.txt

Robots Exclusion Standard data for ilimdunyasi.com

Resource Scan

Scan Details

Site Domain ilimdunyasi.com
Base Domain ilimdunyasi.com
Scan Status Ok
Last Scan2025-09-26T11:53:37+00:00
Next Scan 2025-10-26T11:53:37+00:00

Last Scan

Scanned2025-09-26T11:53:37+00:00
URL https://ilimdunyasi.com/robots.txt
Domain IPs 194.31.59.85
Response IP 194.31.59.85
Found Yes
Hash f0351478390bd1465ad88ac9c4e80bfa566b77d699b92cdb08b8c71881772ab2
SimHash 8254e51a2c17

Groups

sogou web spider/4.0

Rule Path
Disallow /

meta-externalagent

Rule Path
Disallow /

monitoring360bot/1.1

Rule Path
Disallow /

meta-externalagent

Rule Path
Disallow /

barkrowler

Rule Path
Disallow /

linguee

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

cliqzbot

Rule Path
Disallow /

ahrefsbot/5.2

Rule Path
Disallow /

omgili/0.5

Rule Path
Disallow /

omgili

Rule Path
Disallow /

qwantify/2.3w

Rule Path
Disallow /

qwantify

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

semrushbot-sa

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

nerdybot

Rule Path
Disallow /

wbsearchbot

Rule Path
Disallow /

Warnings

  • 2 invalid lines.