copy-write.co.uk
robots.txt
Robots Exclusion Standard data for copy-write.co.uk
Resource Scan
Scan Details
| Site Domain | copy-write.co.uk |
| Base Domain | copy-write.co.uk |
| Scan Status | Ok |
| Last Scan | 2024-09-09T07:29:41+00:00 |
| Next Scan | 2024-10-09T07:29:41+00:00 |
Last Scan
| Scanned | 2024-09-09T07:29:41+00:00 |
| URL | https://www.copy-write.co.uk/robots.txt |
| Domain IPs | 178.159.1.140 |
| Response IP | 178.159.1.140 |
| Found | Yes |
| Hash | 94e6bb9c72fce9cca3fdb57ec14d7fcda9a6e233684b3a39000931fabde5cc3c |
| SimHash | 7d365d74deea |
Groups
semrushbot
semrushbot-ba
semrushbot-si
semrushbot-swa
semrushbot-ct
semrushbot-bm
semrushbot-coub
semrushbot/7~bl
ahrefsbot
siteauditbot
splitsignalbot
baiduspider
yandex
yisouspider
bytespider
sogou web spider
sogou inst spider
blexbot
headline.com
headline
ev-crawler
ccbot
netcraftsurveyagent
yandexcalendar
yandexmobilebot
dotbot
ioncrawl
barkrowler
seznambot
seznambot/4.0
serpstatbot
mj12bot
claudebot
petalbot
dnbcrawler-analytics
coccocbot-web
coccocbot-image
coccocbot-video
coccocbot-news
webmeupbot
| Rule | Path |
|---|---|
| Disallow | / |
bingbot
| Rule | Path |
|---|---|
| Disallow | /e404 |
| Disallow | /css/custom.rows.*.css |
| Disallow | /file-uploaded |
| Disallow | /file-renamed |
| Disallow | /thumb-changed |
| Disallow | /item-deleted |
| Disallow | /create-crm-thumb |
| Disallow | /asset-machinery |
| Disallow | /asset-recycle |
| Disallow | /asset-custom |
| Disallow | /plugin-custom |
| Disallow | /footer-pages-asset |
| Disallow | /modules-assets |
| Disallow | /sync-asset-def |
| Disallow | /seic |
| Disallow | /webp-upload |
| Disallow | /delete-file |
| Disallow | /maintenance |
| Disallow | /assets/post |
| Disallow | /stc-download-source |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 5 |
*
| Rule | Path |
|---|---|
| Disallow | /e404 |
| Disallow | /css/custom.rows.*.css |
| Disallow | /file-uploaded |
| Disallow | /file-renamed |
| Disallow | /thumb-changed |
| Disallow | /item-deleted |
| Disallow | /create-crm-thumb |
| Disallow | /asset-machinery |
| Disallow | /asset-recycle |
| Disallow | /asset-custom |
| Disallow | /plugin-custom |
| Disallow | /footer-pages-asset |
| Disallow | /modules-assets |
| Disallow | /sync-asset-def |
| Disallow | /seic |
| Disallow | /webp-upload |
| Disallow | /delete-file |
| Disallow | /maintenance |
| Disallow | /assets/post |
| Disallow | /stc-download-source |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.copy-write.co.uk/sitemap/ |
Warnings
- 1 invalid line.
Comments