courtsite.my
robots.txt

Robots Exclusion Standard data for courtsite.my

Resource Scan

Scan Details

Site Domain courtsite.my
Base Domain courtsite.my
Scan Status Ok
Last Scan2024-11-13T14:47:28+00:00
Next Scan 2024-11-20T14:47:28+00:00

Last Scan

Scanned2024-11-13T14:47:28+00:00
URL https://courtsite.my/robots.txt
Redirect https://www.courtsite.my/robots.txt
Redirect Domain www.courtsite.my
Redirect Base courtsite.my
Domain IPs 104.21.5.147, 172.67.154.182, 2606:4700:3031::ac43:9ab6, 2606:4700:3033::6815:593
Redirect IPs 151.101.1.195, 151.101.65.195
Response IP 151.101.65.195
Found Yes
Hash b0a57b8140b89fcbc01474cc38a4ed6d412cb03baac68031e30d69a509a66018
SimHash f05051c0dce6

Groups

gptbot

Rule Path
Disallow /

google-extended

Rule Path
Disallow /

perplexitybot

Rule Path
Disallow /

amazonbot

Rule Path
Disallow /

claudebot

Rule Path
Disallow /

omgilibot

Rule Path
Disallow /

facebookbot

Rule Path
Disallow /

applebot-extended

Rule Path
Disallow /

anthropic-ai

Rule Path
Disallow /

bytespider

Rule Path
Disallow /

claude-web

Rule Path
Disallow /

diffbot

Rule Path
Disallow /

imagesiftbot

Rule Path
Disallow /

omgilibot

Rule Path
Disallow /

omgili

Rule Path
Disallow /

youbot

Rule Path
Disallow /

Comments

  • Dah makan? Please lah. Don't eat our data without express written permission.
  • We permit certain automated / programmatic access to our pages for the
  • limited purpose of including content in approved publicly available
  • search engines, and for accessibility.
  • If you are unsure, let's talk! https://www.courtsite.my/support/contact
  • If you like what we're doing, help make us better!
  • We're hiring ;) https://my.hiredly.com/companies/courtsite