dsd.gov.hk
robots.txt

Robots Exclusion Standard data for dsd.gov.hk

Resource Scan

Scan Details

Site Domain dsd.gov.hk
Base Domain dsd.gov.hk
Scan Status Ok
Last Scan2025-05-26T22:56:23+00:00
Next Scan 2025-06-25T22:56:23+00:00

Last Scan

Scanned2025-05-26T22:56:23+00:00
URL https://dsd.gov.hk/robots.txt
Redirect https://www.dsd.gov.hk/robots.txt
Redirect Domain www.dsd.gov.hk
Redirect Base dsd.gov.hk
Domain IPs 2406:da18:689:ea00:2bed:9a2c:499c:2906, 43.154.94.77, 52.221.150.238
Redirect IPs 216.6.5.51, 23.251.120.94, 2405:2000:2600:100::32, 2602:ffe4:401:1b::22
Response IP 216.6.5.51
Found Yes
Hash 45c452d8629a72660a7be5d0c3ab582e50921ba64620de796428a96e212a63c1
SimHash c515f5722a75

Groups

*

Rule Path
Allow /
Disallow /assets
Disallow /common
Disallow /images/
Disallow /EN/images/
Disallow /TC/images/
Disallow /SC/images/
Disallow /EN/uploadimages/
Disallow /TC/uploadimages/
Disallow /SC/uploadimages/

Other Records

Field Value
sitemap https://www.dsd.gov.hk/sitemap_hats.xml
sitemap https://www.dsd.gov.hk/sitemap-sr2021.xml
sitemap https://www.dsd.gov.hk/sitemap.xml
sitemap https://www.dsd.gov.hk/sitemap_page.xml
sitemap https://www.dsd.gov.hk/sitemap_directorate.xml
sitemap https://www.dsd.gov.hk/sitemap_recruitmentnotice.xml
sitemap https://www.dsd.gov.hk/sitemap_contentpage.xml
sitemap https://www.dsd.gov.hk/sitemap_whatsnew.xml
sitemap https://www.dsd.gov.hk/sitemap_pressrelease.xml
sitemap https://www.dsd.gov.hk/sitemap_currenttender.xml
sitemap https://www.dsd.gov.hk/sitemap_allprojects.xml
sitemap https://www.dsd.gov.hk/sitemap_contractsconsultanciesawarded.xml
sitemap https://www.dsd.gov.hk/sitemap_thematic.xml
sitemap https://www.dsd.gov.hk/sitemap_newsletter.xml
sitemap https://www.dsd.gov.hk/sitemap_publication.xml