skorexpress.com
robots.txt

Robots Exclusion Standard data for skorexpress.com

Resource Scan

Scan Details

Site Domain skorexpress.com
Base Domain skorexpress.com
Scan Status Ok
Last Scan2024-09-20T03:14:45+00:00
Next Scan 2024-09-27T03:14:45+00:00

Last Scan

Scanned2024-09-20T03:14:45+00:00
URL https://skorexpress.com/robots.txt
Redirect https://skor-express.com/robots.txt
Redirect Domain skor-express.com
Redirect Base skor-express.com
Domain IPs 104.21.86.45, 172.67.215.16, 2606:4700:3032::6815:562d, 2606:4700:3034::ac43:d710
Redirect IPs 154.92.9.0, 154.92.9.1
Response IP 154.92.9.1
Found Yes
Hash ad0b82521bc47e26145089b110ea520e8a25d9c7acde16cc0f6d67b802e97012
SimHash 0b151555c1d3

Groups

yandexbot
bingbot
mail.ru_bot
amazonbot
applebot
yandeximages
linespider
web-crawler
mediatoolkitbot
qwantify
ccbot
bingpreview
facebookbot
archiver
seznambot
sogou web spider
coccocbot
dataforseobot
gptbot

Rule Path
Disallow /

*

Rule Path
Allow /football/tournaments/*/results
Allow /football/tournaments/*/standings
Allow /football/tournaments/*/teams
Allow /football/tournaments/*/top-scorers
Allow /football/tournaments/*/fixtures
Disallow /my-games
Disallow /*h2h$
Disallow /football/matches/*/standings
Disallow /*home$
Disallow /*away$
Disallow /football/tournaments/*/standings/*
Disallow /football/tournaments/*/results/*
Disallow /football/tournaments/*/teams/*
Disallow /football/tournaments/*/top-scorers/*
Disallow /football/tournaments/*/*/*
Disallow *?matchList=
Disallow *?blank=true
Disallow /cdn-cgi/
Disallow /count-live-matches
Disallow /get-my-games-data
Disallow *tab%3D*
Disallow /rating/comments/*

Other Records

Field Value
sitemap https://skor-express.com/sitemap.xml