hdmall.co.th
robots.txt

Robots Exclusion Standard data for hdmall.co.th

Resource Scan

Scan Details

Site Domain hdmall.co.th
Base Domain hdmall.co.th
Scan Status Ok
Last Scan2024-10-07T21:35:42+00:00
Next Scan 2024-10-21T21:35:42+00:00

Last Scan

Scanned2024-10-07T21:35:42+00:00
URL https://hdmall.co.th/robots.txt
Domain IPs 104.26.12.237, 104.26.13.237, 172.67.72.127, 2606:4700:20::681a:ced, 2606:4700:20::681a:ded, 2606:4700:20::ac43:487f
Response IP 104.26.12.237
Found Yes
Hash 4ba3243451bd1cc49d88cb26573fb663445aa10a20bc617d6a8db6f64661b97d
SimHash a13dd443cbb0

Groups

*

Rule Path
Disallow /health-checkup?brands=*
Disallow /dental-clinics?brands=*
Disallow /beauty?brands=*
Disallow /pets?brands=*
Disallow /insurance?brands=*
Disallow /surgeries?brands=*
Disallow /health-checkup?categories=*
Disallow /dental-clinics?categories=*
Disallow /beauty?categories=*
Disallow /pets?categories=*
Disallow /insurance?categories=*
Disallow /surgeries?categories=*
Disallow /health-checkup?rate=*
Disallow /dental-clinics?rate=*
Disallow /beauty?rate=*
Disallow /pets?rate=*
Disallow /insurance?rate=*
Disallow /surgeries?rate=*
Disallow /health-checkup?districts=*
Disallow /dental-clinics?districts=*
Disallow /beauty?districts=*
Disallow /pets?districts=*
Disallow /insurance?districts=*
Disallow /surgeries?districts=*
Disallow /health-checkup?public_transit_stations=*
Disallow /dental-clinics?public_transit_stations=*
Disallow /beauty?public_transit_stations=*
Disallow /pets?public_transit_stations=*
Disallow /insurance?public_transit_stations=*
Disallow /surgeries?public_transit_stations=*
Disallow /health-checkup?category_tags=*
Disallow /dental-clinics?category_tags=*
Disallow /beauty?category_tags=*
Disallow /pets?category_tags=*
Disallow /insurance?category_tags=*
Disallow /surgeries?category_tags=*
Disallow /brands?categories=*
Disallow /brands?shops=*
Disallow /brands?districts=*
Disallow /tags?category_tags=*
Disallow /*/products?categories=*
Disallow /package_reviews/*
Disallow /search*
Disallow /*category_tags*
Disallow /*brands%3D*
Disallow /*direction%3D*
Disallow /*sort%3D*
Disallow /*public_transit_stations%3D*
Disallow /*districts%3D*
Disallow /*users*
Disallow /*buy_package_modal*
Disallow /*initiate-pharmacy-chat*

bingbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

ahrefsbot

Rule Path
Disallow /

uptimerobot

Rule Path
Disallow /

yandex

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

dataforseobot

Rule Path
Disallow /

pinterestbot

Rule Path
Disallow /

barkrowler

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

ia_archiver

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

scrapy

Rule Path
Disallow /

Other Records

Field Value
sitemap https://hdmall.co.th/shop_sitemaps/sitemap.xml.gz