fscore.co.tz
robots.txt
Robots Exclusion Standard data for fscore.co.tz
Resource Scan
Scan Details
Site Domain | fscore.co.tz |
Base Domain | fscore.co.tz |
Scan Status | Failed |
Failure Stage | Fetching resource. |
Failure Reason | Server returned a client error. |
Last Scan | 2024-05-15T12:06:16+00:00 |
Next Scan | 2024-05-29T12:06:16+00:00 |
Last Successful Scan
Scanned | 2024-04-30T11:56:50+00:00 |
URL | https://fscore.co.tz/robots.txt |
Domain IPs | 154.92.9.4, 154.92.9.5 |
Response IP | 154.92.9.4 |
Found | Yes |
Hash | 5456fc394a280abfbb4e349c8568fa16bbb231e2f88f12bbb76172b8a14006fa |
SimHash | 4d141a6383d9 |
Groups
yandexbot
bingbot
mail.ru_bot
amazonbot
applebot
yandeximages
linespider
web-crawler
mediatoolkitbot
qwantify
ccbot
bingpreview
facebookbot
archiver
seznambot
sogou web spider
coccocbot
Rule | Path |
---|---|
Disallow | / |
*
Rule | Path |
---|---|
Disallow | /*tables$ |
Disallow | /leagues/*/standings/* |
Disallow | /my-games$ |
Disallow | *?refresh= |
Disallow | *?order= |
Disallow | *?matchList= |
Disallow | /proxy?url= |
Disallow | /subscribe$ |
Disallow | */wicket* |
Disallow | */over* |
Disallow | /cricket?query= |
Disallow | */chat |
Disallow | *scorecard* |
Disallow | *menuOpen%3D* |
Disallow | /cdn-cgi/ |
Disallow | *tab%3D* |