cat.fictionexpress.com
robots.txt
Robots Exclusion Standard data for cat.fictionexpress.com
Resource Scan
Scan Details
| Site Domain | cat.fictionexpress.com |
| Base Domain | fictionexpress.com |
| Scan Status | Ok |
| Last Scan | 2024-11-03T07:28:38+00:00 |
| Next Scan | 2024-12-03T07:28:38+00:00 |
Last Scan
| Scanned | 2024-11-03T07:28:38+00:00 |
| URL | https://cat.fictionexpress.com/robots.txt |
| Domain IPs | 18.155.68.11, 18.155.68.3, 18.155.68.39, 18.155.68.71, 2600:9000:23d2:1a00:14:2ba9:8440:93a1, 2600:9000:23d2:5200:14:2ba9:8440:93a1, 2600:9000:23d2:5800:14:2ba9:8440:93a1, 2600:9000:23d2:8600:14:2ba9:8440:93a1, 2600:9000:23d2:a800:14:2ba9:8440:93a1, 2600:9000:23d2:d600:14:2ba9:8440:93a1, 2600:9000:23d2:e000:14:2ba9:8440:93a1, 2600:9000:23d2:fc00:14:2ba9:8440:93a1 |
| Response IP | 18.155.68.71 |
| Found | Yes |
| Hash | 739cd3758a720499297ed88553d8fc801f616e2aa20a511fabaa1a62619f98e7 |
| SimHash | 4d0a1fe56093 |
Groups
*
| Rule | Path |
|---|---|
| Allow | /static/images/logo/ |
| Allow | /media/thumbnails/ |
| Allow | /static/images/social/ |
| Allow | /static/images/fotos/ |
| Allow | /static/images/dibujos/ |
| Allow | /static/images/banner/ |
| Disallow | /static/ |
| Disallow | /media/ |
| Disallow | /priv/ |
| Disallow | /pagos/ |
| Disallow | /forum/ |
| Disallow | /foro/ |
| Disallow | /account/ |
| Disallow | /cuenta/ |
| Disallow | /compte/ |
spbot/5.0.3
| Rule | Path |
|---|---|
| Disallow | /static/ |
| Disallow | /static/images/logo/ |
| Disallow | /media/thumbnails/ |
| Disallow | /static/images/social/ |
| Disallow | /static/images/fotos/ |
| Disallow | /static/images/dibujos/ |
| Disallow | /static/images/banner/ |
| Disallow | /media/ |
| Disallow | /priv/ |
| Disallow | /* |
| Disallow | /pagos/ |
tracemyfile/1.0
| Rule | Path |
|---|---|
| Disallow | /static/ |
| Disallow | /static/images/logo/ |
| Disallow | /media/thumbnails/ |
| Disallow | /static/images/social/ |
| Disallow | /static/images/fotos/ |
| Disallow | /static/images/dibujos/ |
| Disallow | /static/images/banner/ |
| Disallow | /media/ |
| Disallow | /priv/ |
| Disallow | /* |
| Disallow | /pagos/ |
dotbot/1.1
| Rule | Path |
|---|---|
| Disallow | /static/ |
| Disallow | /static/images/logo/ |
| Disallow | /media/thumbnails/ |
| Disallow | /static/images/social/ |
| Disallow | /static/images/fotos/ |
| Disallow | /static/images/dibujos/ |
| Disallow | /static/images/banner/ |
| Disallow | /media/ |
| Disallow | /priv/ |
| Disallow | /* |
baiduspider/2.0
| Rule | Path |
|---|---|
| Disallow | /static/ |
| Disallow | /static/images/logo/ |
| Disallow | /media/thumbnails/ |
| Disallow | /static/images/social/ |
| Disallow | /static/images/fotos/ |
| Disallow | /static/images/dibujos/ |
| Disallow | /static/images/banner/ |
| Disallow | /media/ |
| Disallow | /priv/ |
| Disallow | /* |
| Disallow | /pagos/ |
seznambot/3.2
| Rule | Path |
|---|---|
| Disallow | /static/ |
| Disallow | /static/images/logo/ |
| Disallow | /media/thumbnails/ |
| Disallow | /static/images/social/ |
| Disallow | /static/images/fotos/ |
| Disallow | /static/images/dibujos/ |
| Disallow | /static/images/banner/ |
| Disallow | /media/ |
| Disallow | /priv/ |
| Disallow | /* |
| Disallow | /pagos/ |
ahrefsbot/5.2
| Rule | Path |
|---|---|
| Disallow | /static/ |
| Disallow | /static/images/logo/ |
| Disallow | /media/thumbnails/ |
| Disallow | /static/images/social/ |
| Disallow | /static/images/fotos/ |
| Disallow | /static/images/dibujos/ |
| Disallow | /static/images/banner/ |
| Disallow | /media/ |
| Disallow | /priv/ |
| Disallow | /* |
| Disallow | /pagos/ |
mj12bot/v1.4.8
| Rule | Path |
|---|---|
| Disallow | /static/ |
| Disallow | /static/images/logo/ |
| Disallow | /media/thumbnails/ |
| Disallow | /static/images/social/ |
| Disallow | /static/images/fotos/ |
| Disallow | /static/images/dibujos/ |
| Disallow | /static/images/banner/ |
| Disallow | /media/ |
| Disallow | /priv/ |
| Disallow | /* |
| Disallow | /pagos/ |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.fictionexpress.co.uk/sitemap.xml |
Warnings
- `host` is not a known field.