flogr.co.uk
robots.txt
Robots Exclusion Standard data for flogr.co.uk
Resource Scan
Scan Details
| Site Domain | flogr.co.uk |
| Base Domain | flogr.co.uk |
| Scan Status | Ok |
| Last Scan | 2025-09-13T21:01:26+00:00 |
| Next Scan | 2025-09-20T21:01:26+00:00 |
Last Scan
| Scanned | 2025-09-13T21:01:26+00:00 |
| URL | https://flogr.co.uk/robots.txt |
| Redirect | https://www.flogr.co.uk/robots.txt |
| Redirect Domain | www.flogr.co.uk |
| Redirect Base | flogr.co.uk |
| Domain IPs | 104.21.112.1, 104.21.16.1, 104.21.32.1, 104.21.48.1, 104.21.64.1, 104.21.80.1, 104.21.96.1, 2606:4700:3030::6815:1001, 2606:4700:3030::6815:2001, 2606:4700:3030::6815:3001, 2606:4700:3030::6815:4001, 2606:4700:3030::6815:5001, 2606:4700:3030::6815:6001, 2606:4700:3030::6815:7001 |
| Redirect IPs | 104.21.112.1, 104.21.16.1, 104.21.32.1, 104.21.48.1, 104.21.64.1, 104.21.80.1, 104.21.96.1, 2606:4700:3030::6815:1001, 2606:4700:3030::6815:2001, 2606:4700:3030::6815:3001, 2606:4700:3030::6815:4001, 2606:4700:3030::6815:5001, 2606:4700:3030::6815:6001, 2606:4700:3030::6815:7001 |
| Response IP | 104.21.32.1 |
| Found | Yes |
| Hash | 1b5bc744b6c465ac3c57f742894197f0af17566f7ddfb18b2482ed21a7d9b67f |
| SimHash | 290769f4c761 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /cache/ |
| Disallow | /config/ |
| Disallow | /library/ |
| Disallow | /module/ |
| Disallow | /SQL/ |
| Disallow | /cron.php |
| Disallow | /install.php |
| Disallow | /error_log |
| Disallow | /*?SID= |
| Disallow | /admin/ |
| Disallow | /administration/ |
| Disallow | /install/ |
| Disallow | /rss/ |
| Disallow | /advert/ |
| Disallow | /play-video/ |
| Disallow | /app/async* |
| Disallow | /members-area/ |
| Disallow | /members/ |
| Disallow | /sign-in-modal/ |
| Disallow | /sign-up-modal/ |
| Disallow | /forgot-username/ |
| Disallow | /forgot-password/ |
| Disallow | /bid/ |
| Disallow | /buy/ |
| Disallow | /offer/ |
| Disallow | /cart/ |
| Disallow | /listings/cart/ |
| Disallow | /advanced-search/ |
| Disallow | /sell/ |
Comments