fscore.org.uk
robots.txt

Robots Exclusion Standard data for fscore.org.uk

Resource Scan

Scan Details

Site Domain fscore.org.uk
Base Domain fscore.org.uk
Scan Status Ok
Last Scan2024-11-08T06:55:52+00:00
Next Scan 2024-11-15T06:55:52+00:00

Last Scan

Scanned2024-11-08T06:55:52+00:00
URL https://fscore.org.uk/robots.txt
Domain IPs 154.92.9.2, 154.92.9.3
Response IP 154.92.9.3
Found Yes
Hash bdb859aaa1fe444248c684e056e12fa6eafe5968316153181fa4014a4df507d1
SimHash 411c186183c2

Groups

yandexbot
mail.ru_bot
amazonbot
applebot
yandeximages
linespider
web-crawler
mediatoolkitbot
ccbot
facebookbot
archiver
seznambot
sogou web spider
coccocbot
dataforseobot
gptbot

Rule Path
Disallow /

*

Rule Path
Disallow /*tables$
Disallow /leagues/*/standings/*
Disallow /my-games$
Disallow *?refresh=
Disallow *?order=
Disallow *?matchList=
Disallow /proxy?url=
Disallow /subscribe$
Disallow */wicket*
Disallow */over*
Disallow /cricket?query=
Disallow */chat
Disallow *scorecard*
Disallow *menuOpen%3D*
Disallow /cdn-cgi/
Disallow */more-career
Disallow /count-live-games
Disallow /get-my-games-data
Disallow */state/*
Disallow */proxy*
Disallow *?blang=
Disallow /football-load-odds
Disallow *?search=*
Disallow *tab%3D*
Disallow */chat/*
Disallow *tab%3D*
Disallow */casino
Disallow /rating/comments/*