canvayo.com
robots.txt
Robots Exclusion Standard data for canvayo.com
Resource Scan
Scan Details
| Site Domain | canvayo.com |
| Base Domain | canvayo.com |
| Scan Status | Ok |
| Last Scan | 2025-11-30T10:42:39+00:00 |
| Next Scan | 2025-12-30T10:42:39+00:00 |
Last Scan
| Scanned | 2025-11-30T10:42:39+00:00 |
| URL | https://canvayo.com/robots.txt |
| Redirect | https://www.canvayo.com/robots.txt |
| Redirect Domain | www.canvayo.com |
| Redirect Base | canvayo.com |
| Domain IPs | 49.13.155.238 |
| Redirect IPs | 18.159.181.173, 52.59.172.202 |
| Response IP | 18.159.181.173 |
| Found | Yes |
| Hash | f03a3769bae1a5e3668d39a96cf98029884abe8f50b1adc74a6b403c46dd22ac |
| SimHash | 450a5b75c2f5 |
Groups
googlebot
googlebot-video
googlebot-news
googlebot-image
adsbot-google
adsbot-google-mobile
apis-google
google-inspectiontool
googleother
googleother-image
googleother-video
google-extended
google-cloudvertexbot
googleagent-mariner
bingbot
adidxbot
bingpreview
duckduckbot
yandexbot
facebot
facebookexternalhit/1.1
facebookexternalhit/1.0 (+http://www.facebook.com/externalhit_uatext.php)
facebookexternalhit/1.1 (+http://www.facebook.com/externalhit_uatext.php)
baiduspider
baiduspider-image
baiduspider-video
baiduspider-news
mozilla/5.0 (compatible; qwantify/bleriot/1.1; +https://help.qwant.com/bot)
qwantbot
bleriot
qwantify
applebot
exabot
chatgpt-user
gptbot
amazonbot
slurp
hubspot crawler
semrushbot
mozilla/5.0 (compatible; optimizer)
sistrix
rsiteauditor
seobility
mozilla/5.0 (windows nt 10.0; win64; x64) applewebkit/537.36 (khtml, wie gecko) chrome/125.0.6422.142 safari/537.36 eye-able®-report/1.0
popetech-crawlbot
popetech-scanbot
mistralai-user
perplexity-user
perplexitybot
oai-searchbot
anthropic-ai
claudebot
claude-web
applebot-extended
facebookbot
meta-externalagent
bytespider
duckassistbot
cohere-ai
ccbot
youbot
timpibot
diffbot
novaact
gemini-deep-research
chatgpt agent
claude-searchbot
oai-searchbot
| Rule | Path |
|---|---|
| Disallow | */wp-admin/ |
| Allow | */wp-admin/*.css$ |
| Allow | */wp-admin/*.js$ |
| Disallow | */category/ |
| Disallow | */tag/ |
| Disallow | */trackback/ |
| Disallow | */feed/ |
| Disallow | */comments/ |
*
| Rule | Path |
|---|---|
| Disallow | / |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.canvayo.com/sitemap.xml |