perfometrics.co
robots.txt
Robots Exclusion Standard data for perfometrics.co
Resource Scan
Scan Details
| Site Domain | perfometrics.co |
| Base Domain | perfometrics.co |
| Scan Status | Ok |
| Last Scan | 2025-09-18T08:02:11+00:00 |
| Next Scan | 2025-09-25T08:02:11+00:00 |
Last Scan
| Scanned | 2025-09-18T08:02:11+00:00 |
| URL | https://perfometrics.co/robots.txt |
| Domain IPs | 159.198.65.73 |
| Response IP | 159.198.65.73 |
| Found | Yes |
| Hash | 3636d8f17445ff0304c7010826741b021cc062d3e565b3230b4de0f30009e9ac |
| SimHash | 68a032036513 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /*/feed/ |
| Disallow | /feed/ |
| Disallow | /?pagelayer |
| Disallow | /?s= |
| Disallow | /?cat= |
| Allow | / |
chatgptbot
| Rule | Path |
|---|---|
| Disallow | /*/feed/ |
| Disallow | /feed/ |
| Disallow | /?pagelayer |
| Disallow | /?s= |
| Disallow | /?cat= |
| Allow | / |
chatgpt-user
| Rule | Path |
|---|---|
| Disallow | /*/feed/ |
| Disallow | /feed/ |
| Disallow | /?pagelayer |
| Disallow | /?s= |
| Disallow | /?cat= |
| Allow | / |
oai-searchbot
| Rule | Path |
|---|---|
| Disallow | /*/feed/ |
| Disallow | /feed/ |
| Disallow | /?pagelayer |
| Disallow | /?s= |
| Disallow | /?cat= |
| Allow | / |
anthropic-ai
| Rule | Path |
|---|---|
| Disallow | /*/feed/ |
| Disallow | /feed/ |
| Disallow | /?pagelayer |
| Disallow | /?s= |
| Disallow | /?cat= |
| Allow | / |
claudebot
| Rule | Path |
|---|---|
| Disallow | /*/feed/ |
| Disallow | /feed/ |
| Disallow | /?pagelayer |
| Disallow | /?s= |
| Disallow | /?cat= |
| Allow | / |
cohere-ai
| Rule | Path |
|---|---|
| Disallow | /*/feed/ |
| Disallow | /feed/ |
| Disallow | /?pagelayer |
| Disallow | /?s= |
| Disallow | /?cat= |
| Allow | / |
perplexitybot
| Rule | Path |
|---|---|
| Disallow | /*/feed/ |
| Disallow | /feed/ |
| Disallow | /?pagelayer |
| Disallow | /?s= |
| Disallow | /?cat= |
| Allow | / |
youbot
| Rule | Path |
|---|---|
| Disallow | /*/feed/ |
| Disallow | /feed/ |
| Disallow | /?pagelayer |
| Disallow | /?s= |
| Disallow | /?cat= |
| Allow | / |
neevabot
| Rule | Path |
|---|---|
| Disallow | /*/feed/ |
| Disallow | /feed/ |
| Disallow | /?pagelayer |
| Disallow | /?s= |
| Disallow | /?cat= |
| Allow | / |
metaai
| Rule | Path |
|---|---|
| Disallow | /*/feed/ |
| Disallow | /feed/ |
| Disallow | /?pagelayer |
| Disallow | /?s= |
| Disallow | /?cat= |
| Allow | / |
sogou
| Rule | Path |
|---|---|
| Disallow | /*/feed/ |
| Disallow | /feed/ |
| Disallow | /?pagelayer |
| Disallow | /?s= |
| Disallow | /?cat= |
| Allow | / |
yandex
| Rule | Path |
|---|---|
| Disallow | /*/feed/ |
| Disallow | /feed/ |
| Disallow | /?pagelayer |
| Disallow | /?s= |
| Disallow | /?cat= |
| Allow | / |
ccbot
| Rule | Path |
|---|---|
| Disallow | /*/feed/ |
| Disallow | /feed/ |
| Disallow | /?pagelayer |
| Disallow | /?s= |
| Disallow | /?cat= |
| Allow | / |
archive.org_bot
| Rule | Path |
|---|---|
| Disallow | /*/feed/ |
| Disallow | /feed/ |
| Disallow | /?pagelayer |
| Disallow | /?s= |
| Disallow | /?cat= |
| Allow | / |
duckduckbot
| Rule | Path |
|---|---|
| Disallow | /*/feed/ |
| Disallow | /feed/ |
| Disallow | /?pagelayer |
| Disallow | /?s= |
| Disallow | /?cat= |
| Allow | / |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.perfometrics.co/sitemap_index.xml |
Comments