servercan.net
robots.txt

Robots Exclusion Standard data for servercan.net

Resource Scan

Scan Details

Site Domain servercan.net
Base Domain servercan.net
Scan Status Ok
Last Scan2025-09-05T14:33:19+00:00
Next Scan 2025-09-12T14:33:19+00:00

Last Scan

Scanned2025-09-05T14:33:19+00:00
URL https://servercan.net/robots.txt
Domain IPs 163.44.185.183
Response IP 163.44.185.183
Found Yes
Hash 1f7efc279d7afcd4cbdc5ea3016dccf40399b8442e7a4a31def0055e9d55180f
SimHash 48145951c091

Groups

*

Rule Path
Disallow /blog/wp-admin/
Allow /blog/wp-admin/admin-ajax.php

gptbot

Rule Path
Disallow /

chatgpt-user

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

anthropic-ai

Rule Path
Disallow /

perplexitybot

Rule Path
Disallow /

bytespider

Rule Path
Disallow /

diffbot

Rule Path
Disallow /

omgili

Rule Path
Disallow /

cohere-ai

Rule Path
Disallow /

Other Records

Field Value
sitemap https://servercan.net/blog/sitemap.xml