bangkokpost.com
robots.txt

Robots Exclusion Standard data for bangkokpost.com

Resource Scan

Scan Details

Site Domain bangkokpost.com
Base Domain bangkokpost.com
Scan Status Ok
Last Scan2024-05-16T01:03:27+00:00
Next Scan 2024-05-23T01:03:27+00:00

Last Scan

Scanned2024-05-16T01:03:27+00:00
URL https://bangkokpost.com/robots.txt
Redirect https://www.bangkokpost.com/robots.txt
Redirect Domain www.bangkokpost.com
Redirect Base bangkokpost.com
Domain IPs 103.253.133.80, 2001:c00:4618:2006::111d, 2001:c00:4618:2006::111e
Redirect IPs 103.135.108.11, 103.135.108.12, 2400:c540:2::11, 2402:1f00:8001:17ba::
Response IP 103.135.108.11
Found Yes
Hash b7c4337b6fe9e21bda605f8671ea4b176fc018a9148d76bc61facb4db08708f4
SimHash ae265b266551

Groups

googlebot-news

Rule Path
Disallow

googlebot smartphone

Rule Path
Disallow
Disallow /faq/food.php*
Disallow /faq/*
Disallow /faq/
Disallow /share/*
Disallow /share/
Disallow /hits/
Disallow /hits/*?*
Disallow /frame_map/*
Disallow /vdo*/embed
Disallow /*-embed/*
Disallow /*_info_*.html

grapeshot

Rule Path
Disallow

Other Records

Field Value
sitemap https://www.bangkokpost.com/sitemap.xml
sitemap https://www.bangkokpost.com/sitemap_news.xml