en.fictionexpress.com
robots.txt
Robots Exclusion Standard data for en.fictionexpress.com
Resource Scan
Scan Details
| Site Domain | en.fictionexpress.com |
| Base Domain | fictionexpress.com |
| Scan Status | Ok |
| Last Scan | 2024-10-26T01:05:05+00:00 |
| Next Scan | 2024-11-25T01:05:05+00:00 |
Last Scan
| Scanned | 2024-10-26T01:05:05+00:00 |
| URL | https://en.fictionexpress.com/robots.txt |
| Domain IPs | 18.155.68.11, 18.155.68.3, 18.155.68.39, 18.155.68.71, 2600:9000:23d2:1e00:14:2ba9:8440:93a1, 2600:9000:23d2:2e00:14:2ba9:8440:93a1, 2600:9000:23d2:3800:14:2ba9:8440:93a1, 2600:9000:23d2:4a00:14:2ba9:8440:93a1, 2600:9000:23d2:6000:14:2ba9:8440:93a1, 2600:9000:23d2:6600:14:2ba9:8440:93a1, 2600:9000:23d2:9a00:14:2ba9:8440:93a1, 2600:9000:23d2:9e00:14:2ba9:8440:93a1 |
| Response IP | 18.155.68.11 |
| Found | Yes |
| Hash | 4526c0969292e6c0d279a55965798b3732005daccb68f456c7a94d92ae66c9ff |
| SimHash | 450b0f656092 |
Groups
*
| Rule | Path |
|---|---|
| Allow | /static/images/logo/ |
| Allow | /media/thumbnails/ |
| Allow | /static/images/social/ |
| Allow | /static/images/fotos/ |
| Allow | /static/images/dibujos/ |
| Allow | /static/images/banner/ |
| Disallow | /static/ |
| Disallow | /media/ |
| Disallow | /priv/ |
| Disallow | /pagos/ |
| Disallow | /forum/ |
| Disallow | /foro/ |
| Disallow | /account/ |
| Disallow | /cuenta/ |
| Disallow | /compte/ |
spbot/5.0.3
| Rule | Path |
|---|---|
| Disallow | /static/ |
| Disallow | /static/images/logo/ |
| Disallow | /media/thumbnails/ |
| Disallow | /static/images/social/ |
| Disallow | /static/images/fotos/ |
| Disallow | /static/images/dibujos/ |
| Disallow | /static/images/banner/ |
| Disallow | /media/ |
| Disallow | /priv/ |
| Disallow | /* |
| Disallow | /pagos/ |
tracemyfile/1.0
| Rule | Path |
|---|---|
| Disallow | /static/ |
| Disallow | /static/images/logo/ |
| Disallow | /media/thumbnails/ |
| Disallow | /static/images/social/ |
| Disallow | /static/images/fotos/ |
| Disallow | /static/images/dibujos/ |
| Disallow | /static/images/banner/ |
| Disallow | /media/ |
| Disallow | /priv/ |
| Disallow | /* |
| Disallow | /pagos/ |
dotbot/1.1
| Rule | Path |
|---|---|
| Disallow | /static/ |
| Disallow | /static/images/logo/ |
| Disallow | /media/thumbnails/ |
| Disallow | /static/images/social/ |
| Disallow | /static/images/fotos/ |
| Disallow | /static/images/dibujos/ |
| Disallow | /static/images/banner/ |
| Disallow | /media/ |
| Disallow | /priv/ |
| Disallow | /* |
baiduspider/2.0
| Rule | Path |
|---|---|
| Disallow | /static/ |
| Disallow | /static/images/logo/ |
| Disallow | /media/thumbnails/ |
| Disallow | /static/images/social/ |
| Disallow | /static/images/fotos/ |
| Disallow | /static/images/dibujos/ |
| Disallow | /static/images/banner/ |
| Disallow | /media/ |
| Disallow | /priv/ |
| Disallow | /* |
| Disallow | /pagos/ |
seznambot/3.2
| Rule | Path |
|---|---|
| Disallow | /static/ |
| Disallow | /static/images/logo/ |
| Disallow | /media/thumbnails/ |
| Disallow | /static/images/social/ |
| Disallow | /static/images/fotos/ |
| Disallow | /static/images/dibujos/ |
| Disallow | /static/images/banner/ |
| Disallow | /media/ |
| Disallow | /priv/ |
| Disallow | /* |
| Disallow | /pagos/ |
ahrefsbot/5.2
| Rule | Path |
|---|---|
| Disallow | /static/ |
| Disallow | /static/images/logo/ |
| Disallow | /media/thumbnails/ |
| Disallow | /static/images/social/ |
| Disallow | /static/images/fotos/ |
| Disallow | /static/images/dibujos/ |
| Disallow | /static/images/banner/ |
| Disallow | /media/ |
| Disallow | /priv/ |
| Disallow | /* |
| Disallow | /pagos/ |
mj12bot/v1.4.8
| Rule | Path |
|---|---|
| Disallow | /static/ |
| Disallow | /static/images/logo/ |
| Disallow | /media/thumbnails/ |
| Disallow | /static/images/social/ |
| Disallow | /static/images/fotos/ |
| Disallow | /static/images/dibujos/ |
| Disallow | /static/images/banner/ |
| Disallow | /media/ |
| Disallow | /priv/ |
| Disallow | /* |
| Disallow | /pagos/ |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.fictionexpress.co.uk/sitemap.xml |
Warnings
- `host` is not a known field.