oscal.hk
robots.txt

Robots Exclusion Standard data for oscal.hk

Resource Scan

Scan Details

Site Domain oscal.hk
Base Domain oscal.hk
Scan Status Ok
Last Scan2024-10-02T12:34:19+00:00
Next Scan 2024-10-09T12:34:19+00:00

Last Scan

Scanned2024-10-02T12:34:19+00:00
URL https://oscal.hk/robots.txt
Redirect https://www.oscal.hk/robots.txt
Redirect Domain www.oscal.hk
Redirect Base oscal.hk
Domain IPs 18.159.77.152
Redirect IPs 18.159.77.152
Response IP 18.159.77.152
Found Yes
Hash 825b7577fb0742db46440eb7860627a8f480ac9fcc35ba803e2553de389ca450
SimHash 4a58c0b17eb4

Groups

ahrefsbot

Rule Path
Disallow /

crawler4j

Rule Path
Disallow /

wespe.de spider

Rule Path
Disallow /

cimri.com spider 1.x

Rule Path
Disallow /

pricebot

Rule Path
Disallow /

rytebot

Rule Path
Disallow /

mauibot

Rule Path
Disallow /

zumibot

Rule Path
Disallow /

mail.ru_bot

Rule Path
Disallow /

tineye-bot

Rule Path
Disallow /

intersearch.de spider

Rule Path
Disallow /

exabot

Rule Path
Disallow /

exabot-thumbnails

Rule Path
Disallow /

powermarks

Rule Path
Disallow /

linguee

Rule Path
Disallow /

speedy spider

Rule Path
Disallow /

gigabot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

uptimebot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

megaindex.ru

Rule Path
Disallow /

zoominfobot

Rule Path
Disallow /

mail.ru

Rule Path
Disallow /

seznambot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

extlinksbot

Rule Path
Disallow /

aihitbot

Rule Path
Disallow /

researchscan

Rule Path
Disallow /

dnyzbot

Rule Path
Disallow /

spbot

Rule Path
Disallow /

uptimerobot

Rule Path
Disallow /

yunsecuritybot

Rule Path
Disallow /

msnbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5

bingbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5

*

Rule Path
Disallow /products
Disallow /buydetail
Disallow /gallery