baby24hk.com
robots.txt

Robots Exclusion Standard data for baby24hk.com

Resource Scan

Scan Details

Site Domain baby24hk.com
Base Domain baby24hk.com
Scan Status Ok
Last Scan2024-11-13T15:05:13+00:00
Next Scan 2024-11-20T15:05:13+00:00

Last Scan

Scanned2024-11-13T15:05:13+00:00
URL http://baby24hk.com/robots.txt
Redirect http://www.baby24hk.com/robots.txt
Redirect Domain www.baby24hk.com
Redirect Base baby24hk.com
Domain IPs 199.34.228.73
Redirect IPs 199.34.228.73
Response IP 199.34.228.73
Found Yes
Hash 16a8c10e0443e48321dc35ea33983e878aff8ac7ecb74c8af60823c43ba81701
SimHash 2144d8461793

Groups

nerdybot

Rule Path
Disallow /

dotbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

*

Rule Path
Disallow /ajax/
Disallow /apps/
Disallow /http%3A//www.clinic24hk.com
Disallow /http%3A//www.baby24hk.com/1/category/faqfever/1.html
Disallow /http%3A//www.hkkids.com/
Disallow /http%3A//www.baby24hk.com/news/-fever
Disallow /http%3A//ecourse.familyhealthservice.gov.hk/
Disallow /http%3A//www.baby24hk.com/1/post/2014/04/19.html
Disallow /http%3A//www.baby24hk.com/1/post/2014/03/bb.html
Disallow /http%3A//welovehazel.mysinablog.com/index.php
Disallow /http%3A//www.tagcloud-generator.com/
Disallow /http%3A//www.baby24hk.com/1/post/2014/04/20.html
Disallow /http%3A//www.baby24hk.com/news/-indicators-for-fever
Disallow /http%3A//baby.popart.hk/newver/catlist.php?nid=8
Disallow /http%3A//www.baby24hk.com/uploads/1/7/3/8/17381061/5114896_orig.png
Disallow /http%3A//www.discuss.com.hk/viewthread.php?tid=3416819&extra=page%3D1
Disallow /http%3A//www.baby24hk.com/1/post/2014/04/21.html
Disallow /http%3A//www.baby24hk.com/child-health/1

Other Records

Field Value
sitemap http://www.baby24hk.com/sitemap.xml