clinic24hk.com
robots.txt

Robots Exclusion Standard data for clinic24hk.com

Resource Scan

Scan Details

Site Domain clinic24hk.com
Base Domain clinic24hk.com
Scan Status Ok
Last Scan2024-11-08T18:57:28+00:00
Next Scan 2024-11-15T18:57:28+00:00

Last Scan

Scanned2024-11-08T18:57:28+00:00
URL https://clinic24hk.com/robots.txt
Redirect https://www.clinic24hk.com/robots.txt
Redirect Domain www.clinic24hk.com
Redirect Base clinic24hk.com
Domain IPs 199.34.228.43
Redirect IPs 199.34.228.43
Response IP 199.34.228.43
Found Yes
Hash 1309bc5455e16ba19ac77a5508f73d0bc8073679f47aafc8af999b79c4feacd0
SimHash 6215d4145713

Groups

nerdybot

Rule Path
Disallow /

dotbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

*

Rule Path
Disallow /ajax/
Disallow /apps/
Disallow /http%3A//www.clinic24hk.com/2/category/3144938263%2023478242373729129983a0004f3275/1.html
Disallow /http%3A//www.clinic24hk.com/23560311853827235386.html
Disallow /https%3A//www.clinic24hk.com/blog/category/news-covid-19
Disallow /http%3A//www.clinic24hk.com/246133015123460.html
Disallow /http%3A//www.clinic24hk.com/sitemap.html
Disallow /http%3A//www.clinic24hk.com/department-of-health
Disallow /http%3A//www.clinic24hk.com/doctor
Disallow /http%3A//www.clinic24hk.com/veterinary/-vet-lists-search-by-district
Disallow /http%3A//www.clinic24hk.com/pet
Disallow /http%3A//www.clinic24hk.com/dentists/welcome
Disallow /http%3A//www.clinic24hk.com/activity
Disallow /http%3A//www.clinic24hk.com/columns1
Disallow /http%3A//www.clinic24hk.com/admin-corner
Disallow /http%3A//www.clinic24hk.com/about-us/-contact-us
Disallow /http%3A//www.clinic24hk.com/chinese-medicine
Disallow /http%3A//www.clinic24hk.com/chiropractors
Disallow /http%3A//www.clinic24hk.com/family-planning-association
Disallow /http%3A//www.clinic24hk.com/encyclopaedia
Disallow /http%3A//www.clinic24hk.com/compliment
Disallow /http%3A//www.clinic24hk.com/marketing

Other Records

Field Value
sitemap https://www.clinic24hk.com/sitemap.xml