Log In Sign Up

ceoof.me
robots.txt

Robots Exclusion Standard data for ceoof.me

Resource Scan

Scan Details

Site Domain ceoof.me
Base Domain ceoof.me
Scan Status Ok
Last Scan2026-01-24T05:47:54+00:00
Next Scan 2026-02-23T05:47:54+00:00

Last Scan

Scanned2026-01-24T05:47:54+00:00
URL https://ceoof.me/robots.txt
Redirect https://www.ceoof.me/robots.txt
Redirect Domain www.ceoof.me
Redirect Base ceoof.me
Domain IPs 89.106.200.1
Redirect IPs 18.155.68.20, 18.155.68.80, 18.155.68.83, 18.155.68.98, 2600:9000:23d2:1200:7:c237:c340:93a1, 2600:9000:23d2:8000:7:c237:c340:93a1, 2600:9000:23d2:8c00:7:c237:c340:93a1, 2600:9000:23d2:9a00:7:c237:c340:93a1, 2600:9000:23d2:a400:7:c237:c340:93a1, 2600:9000:23d2:b000:7:c237:c340:93a1, 2600:9000:23d2:ea00:7:c237:c340:93a1, 2600:9000:23d2:fe00:7:c237:c340:93a1
Response IP 18.155.68.20
Found Yes
Hash d46e51e8fd378153c15116fe882d5776a2c53bd3e5f3e074043bd975757e8e20
SimHash 5b30cd50a2f5

Groups

gptbot

Rule Path
Disallow /

chatgpt-user

Rule Path
Disallow /

claudebot

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

anthropic-ai

Rule Path
Disallow /

amazonbot

Rule Path
Disallow /

bytespider

Rule Path
Disallow /

yeti

Rule Path
Disallow /

*

Rule Path
Disallow /wp-admin/
Disallow /wp-login.php
Disallow /wp-content/
Disallow /wp-includes/
Disallow /xmlrpc.php

*

Rule Path
Allow /
Back to top

Other Records

Field Value
sitemap https://www.ceoof.me/sitemap.xml
Back to top

Comments

  • Block known AI scrapers
  • Block WordPress-related paths
  • Optional: Allow all other bots to crawl the public site
Back to top