fbcmb.co.uk
robots.txt
Robots Exclusion Standard data for fbcmb.co.uk
Resource Scan
Scan Details
| Site Domain | fbcmb.co.uk |
| Base Domain | fbcmb.co.uk |
| Scan Status | Ok |
| Last Scan | 2024-09-22T05:08:24+00:00 |
| Next Scan | 2024-10-22T05:08:24+00:00 |
Last Scan
| Scanned | 2024-09-22T05:08:24+00:00 |
| URL | https://www.fbcmb.co.uk/robots.txt |
| Domain IPs | 178.159.1.140 |
| Response IP | 178.159.1.140 |
| Found | Yes |
| Hash | 561e4dfae7f2721932c90d01887cc2079387f897e7bd549cfdbf5d92c4abf638 |
| SimHash | 7d145d74dee8 |
Groups
semrushbot
semrushbot-ba
semrushbot-si
semrushbot-swa
semrushbot-ct
semrushbot-bm
semrushbot-coub
semrushbot/7~bl
ahrefsbot
siteauditbot
splitsignalbot
baiduspider
yandex
yisouspider
bytespider
sogou web spider
sogou inst spider
blexbot
headline.com
headline
ev-crawler
ccbot
netcraftsurveyagent
yandexcalendar
yandexmobilebot
dotbot
ioncrawl
barkrowler
seznambot
seznambot/4.0
serpstatbot
mj12bot
claudebot
petalbot
dnbcrawler-analytics
coccocbot-web
coccocbot-image
coccocbot-video
coccocbot-news
webmeupbot
| Rule | Path |
|---|---|
| Disallow | / |
bingbot
| Rule | Path |
|---|---|
| Disallow | /e404 |
| Disallow | /css/custom.rows.*.css |
| Disallow | /file-uploaded |
| Disallow | /file-renamed |
| Disallow | /thumb-changed |
| Disallow | /item-deleted |
| Disallow | /create-crm-thumb |
| Disallow | /asset-machinery |
| Disallow | /asset-recycle |
| Disallow | /asset-custom |
| Disallow | /plugin-custom |
| Disallow | /footer-pages-asset |
| Disallow | /modules-assets |
| Disallow | /sync-asset-def |
| Disallow | /seic |
| Disallow | /webp-upload |
| Disallow | /delete-file |
| Disallow | /maintenance |
| Disallow | /assets/post |
| Disallow | /stc-download-source |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 5 |
*
| Rule | Path |
|---|---|
| Disallow | /e404 |
| Disallow | /css/custom.rows.*.css |
| Disallow | /file-uploaded |
| Disallow | /file-renamed |
| Disallow | /thumb-changed |
| Disallow | /item-deleted |
| Disallow | /create-crm-thumb |
| Disallow | /asset-machinery |
| Disallow | /asset-recycle |
| Disallow | /asset-custom |
| Disallow | /plugin-custom |
| Disallow | /footer-pages-asset |
| Disallow | /modules-assets |
| Disallow | /sync-asset-def |
| Disallow | /seic |
| Disallow | /webp-upload |
| Disallow | /delete-file |
| Disallow | /maintenance |
| Disallow | /assets/post |
| Disallow | /stc-download-source |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.fbcmb.co.uk/sitemap/ |
Warnings
- 1 invalid line.
Comments