Log In Sign Up

cokoh.com
robots.txt

Robots Exclusion Standard data for cokoh.com

Resource Scan

Scan Details

Site Domain cokoh.com
Base Domain cokoh.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-11-02T11:56:11+00:00
Next Scan 2026-01-31T11:56:11+00:00

Last Successful Scan

Scanned2025-04-07T06:44:45+00:00
URL https://cokoh.com/robots.txt
Redirect https://www.cokoh.com/robots.txt
Redirect Domain www.cokoh.com
Redirect Base cokoh.com
Domain IPs 104.21.45.177, 172.67.217.182, 2606:4700:3031::ac43:d9b6, 2606:4700:3032::6815:2db1
Redirect IPs 104.21.45.177, 172.67.217.182, 2606:4700:3031::ac43:d9b6, 2606:4700:3032::6815:2db1
Response IP 172.67.217.182
Found Yes
Hash af1f91dd71f1134edcf087269279a5287576b0906bc43bf9ca1839a682fea29c
SimHash 346ccb4947d4

Groups

googlebot

Rule Path
Allow /

bingbot

Rule Path
Allow /

Other Records

Field Value Comment
crawl-delay 60 Allow Bingbot to wait 60 seconds between accessing each page

applebot

Rule Path
Allow /

Other Records

Field Value Comment
crawl-delay 120 Allow Applebot to wait 120 seconds between accessing each page

petalbot

Rule Path
Allow /

Other Records

Field Value Comment
crawl-delay 120 Allow PetalBot to wait 120 seconds between accessing each page

semrushbot

Rule Path
Disallow /

webmeup

Rule Path
Disallow /

grapeshotcrawler

Rule Path
Disallow /

*

Rule Path
Disallow /loginedit.php?*
Disallow /producttag/*
Disallow /logindel.php?*
Disallow /messenger/*
Disallow /contactlist.php?*
Disallow /sendcomment.php?*
Disallow /videocall.php?*
Disallow /contentpreview.php?*
Disallow /marketplace/nofollow.asp?*
Disallow /marketplace/question.asp*
Disallow /marketplace/productsearch.asp?*
Disallow /loginedit.php
Disallow /logindel.php

*

No rules defined. All paths allowed.

Other Records

Field Value Comment
crawl-delay 120 Allow unspecified bots to wait 60 seconds between accessing each page
Back to top

Other Records

Field Value
sitemap https://www.cokoh.com/sitemap.php
Back to top

Comments

  • Allow all major bots full access
  • Crawl-delay for Googlebot set in Google Search Console: 5 seconds
  • Block bots that do not contribute to traffic to save resources
  • Block unnecessary files and directories from indexing
  • Apply general crawl-delay for bots not specified above
  • Sitemap URL to help allowed bots access the website structure more efficiently
Back to top