bccthai.com
robots.txt

Robots Exclusion Standard data for bccthai.com

Resource Scan

Scan Details

Site Domain bccthai.com
Base Domain bccthai.com
Scan Status Ok
Last Scan2025-08-14T21:30:58+00:00
Next Scan 2025-09-13T21:30:58+00:00

Last Scan

Scanned2025-08-14T21:30:58+00:00
URL https://bccthai.com/robots.txt
Domain IPs 54.251.132.119
Response IP 54.251.132.119
Found Yes
Hash 636cd7f0f736a3f262af1296b6f510031fa22e73133d880b24b64df84a767dfe
SimHash 68345f658683

Groups

*

Rule Path
Disallow /asp/cal.asp?

*

Rule Path
Disallow /bcct/asp/gpages.asp?

facebookexternalhit

Rule Path
Disallow /bcct/asp/general.asp

meta-externalagent/1.1

Rule Path
Disallow /

cortex/1.0

Rule Path
Disallow /

scrapy

Rule Path
Disallow /

sogou

Rule Path
Disallow /

amazonbot

Rule Path
Disallow /

coccocbot-web

Rule Path
Disallow /

mj12bot.com

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

seekportbot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://members.bccthai.com/xml/sitemap.xml

Comments

  • robots.txt - Update: 27-Jul-2025 11:34
  • And what exactly are *you* doing today?
  • Interesting file eh?
  • Yours truly, Herman Munster