022.co.il
robots.txt

Robots Exclusion Standard data for 022.co.il

Resource Scan

Scan Details

Site Domain 022.co.il
Base Domain 022.co.il
Scan Status Ok
Last Scan2024-09-09T19:54:06+00:00
Next Scan 2024-10-09T19:54:06+00:00

Last Scan

Scanned2024-09-09T19:54:06+00:00
URL https://022.co.il/robots.txt
Domain IPs 212.179.114.226
Response IP 212.179.114.226
Found Yes
Hash c49795234f9527deac3ade13e55d1dbc825793c58a76a5a2dabc954004f908ed
SimHash 2a7d90e14a70

Groups

*

Rule Path
Disallow /BRPortalStorage/
Disallow /SSLStorage/

Other Records

Field Value
crawl-delay 10

ifatsearch

Rule Path
Disallow /

yandexbot

Rule Path
Disallow /

ezooms

Rule Path
Disallow /

exabot

Rule Path
Disallow /

psbot

Rule Path
Disallow /

mail.ru_bot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

yacybot

Rule Path
Disallow /

sosospider

Rule Path
Disallow /

adbeat_bot

Rule Path
Disallow /

showyoubot

Rule Path
Disallow /

queryseekerspider

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

rollcrawl

Rule Path
Disallow /

cliqusbot

Rule Path
Disallow /

xintellibot

Rule Path
Disallow /

omgilibot

Rule Path
Disallow /