fscore.co.nl
robots.txt
Robots Exclusion Standard data for fscore.co.nl
Resource Scan
Scan Details
| Site Domain | fscore.co.nl |
| Base Domain | fscore.co.nl |
| Scan Status | Ok |
| Last Scan | 2024-11-05T07:58:38+00:00 |
| Next Scan | 2024-11-12T07:58:38+00:00 |
Last Scan
| Scanned | 2024-11-05T07:58:38+00:00 |
| URL | https://fscore.co.nl/robots.txt |
| Domain IPs | 154.92.9.4, 154.92.9.5 |
| Response IP | 154.92.9.5 |
| Found | Yes |
| Hash | 81df8c95d53fe9a1278ed539603764c0b124dbe0da8cfd9fd157101825242f2b |
| SimHash | 6d141a6183d3 |
Groups
yandexbot
bingbot
mail.ru_bot
amazonbot
applebot
yandeximages
linespider
web-crawler
mediatoolkitbot
ccbot
bingpreview
facebookbot
archiver
seznambot
sogou web spider
coccocbot
gptbot
| Rule | Path |
|---|---|
| Disallow | / |
*
| Rule | Path |
|---|---|
| Disallow | /*tables$ |
| Disallow | /leagues/*/standings/* |
| Disallow | /my-games$ |
| Disallow | *?refresh= |
| Disallow | *?order= |
| Disallow | *?matchList= |
| Disallow | /proxy?url= |
| Disallow | /subscribe$ |
| Disallow | */wicket* |
| Disallow | */over* |
| Disallow | /cricket?query= |
| Disallow | */chat |
| Disallow | *scorecard* |
| Disallow | *menuOpen%3D* |
| Disallow | /cdn-cgi/ |
| Disallow | /rating/comments/* |