us.fictionexpress.com
robots.txt
Robots Exclusion Standard data for us.fictionexpress.com
Resource Scan
Scan Details
| Site Domain | us.fictionexpress.com |
| Base Domain | fictionexpress.com |
| Scan Status | Ok |
| Last Scan | 2024-11-03T08:10:26+00:00 |
| Next Scan | 2024-12-03T08:10:26+00:00 |
Last Scan
| Scanned | 2024-11-03T08:10:26+00:00 |
| URL | https://us.fictionexpress.com/robots.txt |
| Domain IPs | 18.155.68.11, 18.155.68.3, 18.155.68.39, 18.155.68.71, 2600:9000:21d1:2400:14:2ba9:8440:93a1, 2600:9000:21d1:3000:14:2ba9:8440:93a1, 2600:9000:21d1:3400:14:2ba9:8440:93a1, 2600:9000:21d1:3800:14:2ba9:8440:93a1, 2600:9000:21d1:5600:14:2ba9:8440:93a1, 2600:9000:21d1:6a00:14:2ba9:8440:93a1, 2600:9000:21d1:b600:14:2ba9:8440:93a1, 2600:9000:21d1:e400:14:2ba9:8440:93a1 |
| Response IP | 18.155.68.3 |
| Found | Yes |
| Hash | f880ec88eb92866414ac84616dfd40271bd94f71886ca6fa7c35908c15411276 |
| SimHash | 450a0f656893 |
Groups
*
| Rule | Path |
|---|---|
| Allow | /static/images/logo/ |
| Allow | /media/thumbnails/ |
| Allow | /static/images/social/ |
| Allow | /static/images/fotos/ |
| Allow | /static/images/dibujos/ |
| Allow | /static/images/banner/ |
| Disallow | /static/ |
| Disallow | /media/ |
| Disallow | /priv/ |
| Disallow | /pagos/ |
| Disallow | /forum/ |
| Disallow | /foro/ |
| Disallow | /account/ |
| Disallow | /cuenta/ |
| Disallow | /compte/ |
spbot/5.0.3
| Rule | Path |
|---|---|
| Disallow | /static/ |
| Disallow | /static/images/logo/ |
| Disallow | /media/thumbnails/ |
| Disallow | /static/images/social/ |
| Disallow | /static/images/fotos/ |
| Disallow | /static/images/dibujos/ |
| Disallow | /static/images/banner/ |
| Disallow | /media/ |
| Disallow | /priv/ |
| Disallow | /* |
| Disallow | /pagos/ |
tracemyfile/1.0
| Rule | Path |
|---|---|
| Disallow | /static/ |
| Disallow | /static/images/logo/ |
| Disallow | /media/thumbnails/ |
| Disallow | /static/images/social/ |
| Disallow | /static/images/fotos/ |
| Disallow | /static/images/dibujos/ |
| Disallow | /static/images/banner/ |
| Disallow | /media/ |
| Disallow | /priv/ |
| Disallow | /* |
| Disallow | /pagos/ |
dotbot/1.1
| Rule | Path |
|---|---|
| Disallow | /static/ |
| Disallow | /static/images/logo/ |
| Disallow | /media/thumbnails/ |
| Disallow | /static/images/social/ |
| Disallow | /static/images/fotos/ |
| Disallow | /static/images/dibujos/ |
| Disallow | /static/images/banner/ |
| Disallow | /media/ |
| Disallow | /priv/ |
| Disallow | /* |
baiduspider/2.0
| Rule | Path |
|---|---|
| Disallow | /static/ |
| Disallow | /static/images/logo/ |
| Disallow | /media/thumbnails/ |
| Disallow | /static/images/social/ |
| Disallow | /static/images/fotos/ |
| Disallow | /static/images/dibujos/ |
| Disallow | /static/images/banner/ |
| Disallow | /media/ |
| Disallow | /priv/ |
| Disallow | /* |
| Disallow | /pagos/ |
seznambot/3.2
| Rule | Path |
|---|---|
| Disallow | /static/ |
| Disallow | /static/images/logo/ |
| Disallow | /media/thumbnails/ |
| Disallow | /static/images/social/ |
| Disallow | /static/images/fotos/ |
| Disallow | /static/images/dibujos/ |
| Disallow | /static/images/banner/ |
| Disallow | /media/ |
| Disallow | /priv/ |
| Disallow | /* |
| Disallow | /pagos/ |
ahrefsbot/5.2
| Rule | Path |
|---|---|
| Disallow | /static/ |
| Disallow | /static/images/logo/ |
| Disallow | /media/thumbnails/ |
| Disallow | /static/images/social/ |
| Disallow | /static/images/fotos/ |
| Disallow | /static/images/dibujos/ |
| Disallow | /static/images/banner/ |
| Disallow | /media/ |
| Disallow | /priv/ |
| Disallow | /* |
| Disallow | /pagos/ |
mj12bot/v1.4.8
| Rule | Path |
|---|---|
| Disallow | /static/ |
| Disallow | /static/images/logo/ |
| Disallow | /media/thumbnails/ |
| Disallow | /static/images/social/ |
| Disallow | /static/images/fotos/ |
| Disallow | /static/images/dibujos/ |
| Disallow | /static/images/banner/ |
| Disallow | /media/ |
| Disallow | /priv/ |
| Disallow | /* |
| Disallow | /pagos/ |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.fictionexpress.co.uk/sitemap.xml |
Warnings
- `host` is not a known field.