fscores.com.br
robots.txt

Robots Exclusion Standard data for fscores.com.br

Resource Scan

Scan Details

Site Domain fscores.com.br
Base Domain fscores.com.br
Scan Status Ok
Last Scan2024-09-19T11:18:41+00:00
Next Scan 2024-09-26T11:18:41+00:00

Last Scan

Scanned2024-09-19T11:18:41+00:00
URL https://fscores.com.br/robots.txt
Domain IPs 154.92.9.4, 154.92.9.5
Response IP 154.92.9.5
Found Yes
Hash 368f71b02822254af3c430ddc3757aeb95df314f8fad45c07daa923d0315fcc6
SimHash 4d141a6183d1

Groups

yandexbot
bingbot
mail.ru_bot
amazonbot
applebot
yandeximages
linespider
web-crawler
mediatoolkitbot
qwantify
ccbot
bingpreview
facebookbot
archiver
seznambot
sogou web spider
coccocbot
gptbot

Rule Path
Disallow /

*

Rule Path
Disallow /*tables$
Disallow /leagues/*/standings/*
Disallow /my-games$
Disallow *?refresh=
Disallow *?order=
Disallow *?matchList=
Disallow /proxy?url=
Disallow /subscribe$
Disallow */wicket*
Disallow */over*
Disallow /cricket?query=
Disallow */chat
Disallow *scorecard*
Disallow *menuOpen%3D*
Disallow /cdn-cgi/
Disallow *tab%3D*
Disallow /rating/comments/*