glf.tw
robots.txt

Robots Exclusion Standard data for glf.tw

Resource Scan

Scan Details

Site Domain glf.tw
Base Domain glf.tw
Scan Status Ok
Last Scan2026-03-31T22:07:44+00:00
Next Scan 2026-04-07T22:07:44+00:00

Last Scan

Scanned2026-03-31T22:07:44+00:00
URL https://www.glf.tw/robots.txt
Domain IPs 13.75.76.44
Response IP 13.75.76.44
Found Yes
Hash 44bc7a0f1c2905f8f969eb856470f344d5a7bc80fb6a6dc208b8d58ec02055a3
SimHash e1829a51c786

Groups

*

Rule Path
Allow /
Disallow /bin/
Disallow /obj/
Disallow /*.json$
Disallow /next-door-fresh
Disallow /TermsOfService/

googlebot

Rule Path
Allow /

bingbot

Rule Path
Allow /

slurp

Rule Path
Allow /

Other Records

Field Value
crawl-delay 1

Other Records

Field Value
sitemap https://www.epictech.tw/sitemap.xml
sitemap https://www.glf.tw/sitemap.xml

Comments

  • robots.txt for Epic Tech Taiwan / G.Talk
  • Sitemap location
  • Disallow admin and temporary files
  • Disallow removed pages
  • Disallow terms of service pages
  • Allow major search engines
  • Crawl-delay for polite crawling