fictionexpress.com
robots.txt
Robots Exclusion Standard data for fictionexpress.com
Resource Scan
Scan Details
| Site Domain | fictionexpress.com |
| Base Domain | fictionexpress.com |
| Scan Status | Ok |
| Last Scan | 2024-04-24T17:26:11+00:00 |
| Next Scan | 2024-05-24T17:26:11+00:00 |
Last Scan
| Scanned | 2024-04-24T17:26:11+00:00 |
| URL | https://fictionexpress.com/robots.txt |
| Redirect | https://en.fictionexpress.com/robots.txt |
| Redirect Domain | en.fictionexpress.com |
| Redirect Base | fictionexpress.com |
| Domain IPs | 52.50.168.98, 52.51.151.244 |
| Redirect IPs | 18.155.68.11, 18.155.68.3, 18.155.68.39, 18.155.68.71, 2600:9000:23d2:2c00:14:2ba9:8440:93a1, 2600:9000:23d2:3a00:14:2ba9:8440:93a1, 2600:9000:23d2:4400:14:2ba9:8440:93a1, 2600:9000:23d2:5a00:14:2ba9:8440:93a1, 2600:9000:23d2:8600:14:2ba9:8440:93a1, 2600:9000:23d2:a00:14:2ba9:8440:93a1, 2600:9000:23d2:c200:14:2ba9:8440:93a1, 2600:9000:23d2:c400:14:2ba9:8440:93a1 |
| Response IP | 18.155.68.11 |
| Found | Yes |
| Hash | 4526c0969292e6c0d279a55965798b3732005daccb68f456c7a94d92ae66c9ff |
| SimHash | 450b0f656092 |
Groups
*
| Rule | Path |
|---|---|
| Allow | /static/images/logo/ |
| Allow | /media/thumbnails/ |
| Allow | /static/images/social/ |
| Allow | /static/images/fotos/ |
| Allow | /static/images/dibujos/ |
| Allow | /static/images/banner/ |
| Disallow | /static/ |
| Disallow | /media/ |
| Disallow | /priv/ |
| Disallow | /pagos/ |
| Disallow | /forum/ |
| Disallow | /foro/ |
| Disallow | /account/ |
| Disallow | /cuenta/ |
| Disallow | /compte/ |
spbot/5.0.3
| Rule | Path |
|---|---|
| Disallow | /static/ |
| Disallow | /static/images/logo/ |
| Disallow | /media/thumbnails/ |
| Disallow | /static/images/social/ |
| Disallow | /static/images/fotos/ |
| Disallow | /static/images/dibujos/ |
| Disallow | /static/images/banner/ |
| Disallow | /media/ |
| Disallow | /priv/ |
| Disallow | /* |
| Disallow | /pagos/ |
tracemyfile/1.0
| Rule | Path |
|---|---|
| Disallow | /static/ |
| Disallow | /static/images/logo/ |
| Disallow | /media/thumbnails/ |
| Disallow | /static/images/social/ |
| Disallow | /static/images/fotos/ |
| Disallow | /static/images/dibujos/ |
| Disallow | /static/images/banner/ |
| Disallow | /media/ |
| Disallow | /priv/ |
| Disallow | /* |
| Disallow | /pagos/ |
dotbot/1.1
| Rule | Path |
|---|---|
| Disallow | /static/ |
| Disallow | /static/images/logo/ |
| Disallow | /media/thumbnails/ |
| Disallow | /static/images/social/ |
| Disallow | /static/images/fotos/ |
| Disallow | /static/images/dibujos/ |
| Disallow | /static/images/banner/ |
| Disallow | /media/ |
| Disallow | /priv/ |
| Disallow | /* |
baiduspider/2.0
| Rule | Path |
|---|---|
| Disallow | /static/ |
| Disallow | /static/images/logo/ |
| Disallow | /media/thumbnails/ |
| Disallow | /static/images/social/ |
| Disallow | /static/images/fotos/ |
| Disallow | /static/images/dibujos/ |
| Disallow | /static/images/banner/ |
| Disallow | /media/ |
| Disallow | /priv/ |
| Disallow | /* |
| Disallow | /pagos/ |
seznambot/3.2
| Rule | Path |
|---|---|
| Disallow | /static/ |
| Disallow | /static/images/logo/ |
| Disallow | /media/thumbnails/ |
| Disallow | /static/images/social/ |
| Disallow | /static/images/fotos/ |
| Disallow | /static/images/dibujos/ |
| Disallow | /static/images/banner/ |
| Disallow | /media/ |
| Disallow | /priv/ |
| Disallow | /* |
| Disallow | /pagos/ |
ahrefsbot/5.2
| Rule | Path |
|---|---|
| Disallow | /static/ |
| Disallow | /static/images/logo/ |
| Disallow | /media/thumbnails/ |
| Disallow | /static/images/social/ |
| Disallow | /static/images/fotos/ |
| Disallow | /static/images/dibujos/ |
| Disallow | /static/images/banner/ |
| Disallow | /media/ |
| Disallow | /priv/ |
| Disallow | /* |
| Disallow | /pagos/ |
mj12bot/v1.4.8
| Rule | Path |
|---|---|
| Disallow | /static/ |
| Disallow | /static/images/logo/ |
| Disallow | /media/thumbnails/ |
| Disallow | /static/images/social/ |
| Disallow | /static/images/fotos/ |
| Disallow | /static/images/dibujos/ |
| Disallow | /static/images/banner/ |
| Disallow | /media/ |
| Disallow | /priv/ |
| Disallow | /* |
| Disallow | /pagos/ |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.fictionexpress.co.uk/sitemap.xml |
Warnings
- `host` is not a known field.