Log In Sign Up

temok.com
robots.txt

Robots Exclusion Standard data for temok.com

Resource Scan

Scan Details

Site Domain temok.com
Base Domain temok.com
Scan Status Ok
Last Scan2025-08-26T09:54:47+00:00
Next Scan 2025-09-25T09:54:47+00:00

Last Scan

Scanned2025-08-26T09:54:47+00:00
URL https://temok.com/robots.txt
Redirect https://www.temok.com/robots.txt
Redirect Domain www.temok.com
Redirect Base temok.com
Domain IPs 216.198.79.193
Redirect IPs 216.198.79.1, 64.29.17.1
Response IP 64.29.17.1
Found Yes
Hash bc03b87dfae5d431166c547e9cc50a14f8bdbec38d17b66025203c223390d7d4
SimHash 65083854c2f0

Groups

bytespider

Rule Path
Disallow /

bytedance

Rule Path
Disallow /

serverhunter

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 20

googlebot
adsbot-google

Rule Path
Disallow /clients/
Disallow /clients/

*

Rule Path
Disallow
Back to top

Other Records

Field Value
sitemap https://www.temok.com/sitemap.xml
sitemap https://www.temok.com/sitemap_2.xml
Back to top

Comments

  • To block Bytespider from crawling:
  • To block Bytedance from crawling:
  • Directories, disallow directories
  • Paths (clean URLs)
  • Disallow: https://www.temok.com/clients/
  • Disallow: http://temok.com/cliets/
Back to top