Log In Sign Up

edigest.hk
robots.txt

Robots Exclusion Standard data for edigest.hk

Resource Scan

Scan Details

Site Domain edigest.hk
Base Domain edigest.hk
Scan Status Ok
Last Scan2024-06-05T08:38:48+00:00
Next Scan 2024-06-12T08:38:48+00:00

Last Scan

Scanned2024-06-05T08:38:48+00:00
URL https://edigest.hk/robots.txt
Redirect https://www.edigest.hk/robots.txt
Redirect Domain www.edigest.hk
Redirect Base edigest.hk
Domain IPs 104.26.2.250, 104.26.3.250, 172.67.72.48, 2606:4700:20::681a:2fa, 2606:4700:20::681a:3fa, 2606:4700:20::ac43:4830
Redirect IPs 104.26.2.250, 104.26.3.250, 172.67.72.48, 2606:4700:20::681a:2fa, 2606:4700:20::681a:3fa, 2606:4700:20::ac43:4830
Response IP 104.26.3.250
Found Yes
Hash 9d37d56c83dd9c6b33fbd8d9040ee4307fadf7810bf36083be45ee0c695e727b
SimHash c35cd070223a

Groups

*

Rule Path
Disallow /wp-admin/
Disallow /wp-json/
Disallow /wp-json-v1/
Disallow /?s=
Disallow /keyword/
Disallow /page/
Allow /wp-admin/admin-ajax.php

ahrefsbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

criteobot/0.1

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

admantx

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

grapeshot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

voluumdsp-content-bot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

proximic

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

bingbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

dataforseobot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

mj12bot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

blexbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10
Back to top

Other Records

Field Value
sitemap https://www.edigest.hk/sitemap_index.xml
Back to top