skorexpress.com
robots.txt
Robots Exclusion Standard data for skorexpress.com
Resource Scan
Scan Details
Site Domain | skorexpress.com |
Base Domain | skorexpress.com |
Scan Status | Ok |
Last Scan | 2024-11-15T07:46:49+00:00 |
Next Scan | 2024-11-22T07:46:49+00:00 |
Last Scan
Scanned | 2024-11-15T07:46:49+00:00 |
URL | https://skorexpress.com/robots.txt |
Redirect | https://skor-express.com/robots.txt |
Redirect Domain | skor-express.com |
Redirect Base | skor-express.com |
Domain IPs | 104.21.86.45, 172.67.215.16, 2606:4700:3032::6815:562d, 2606:4700:3034::ac43:d710 |
Redirect IPs | 154.92.9.0, 154.92.9.1 |
Response IP | 154.92.9.1 |
Found | Yes |
Hash | ad0b82521bc47e26145089b110ea520e8a25d9c7acde16cc0f6d67b802e97012 |
SimHash | 0b151555c1d3 |
Groups
yandexbot
bingbot
mail.ru_bot
amazonbot
applebot
yandeximages
linespider
web-crawler
mediatoolkitbot
qwantify
ccbot
bingpreview
facebookbot
archiver
seznambot
sogou web spider
coccocbot
dataforseobot
gptbot
Rule | Path |
---|---|
Disallow | / |
*
Rule | Path |
---|---|
Allow | /football/tournaments/*/results |
Allow | /football/tournaments/*/standings |
Allow | /football/tournaments/*/teams |
Allow | /football/tournaments/*/top-scorers |
Allow | /football/tournaments/*/fixtures |
Disallow | /my-games |
Disallow | /*h2h$ |
Disallow | /football/matches/*/standings |
Disallow | /*home$ |
Disallow | /*away$ |
Disallow | /football/tournaments/*/standings/* |
Disallow | /football/tournaments/*/results/* |
Disallow | /football/tournaments/*/teams/* |
Disallow | /football/tournaments/*/top-scorers/* |
Disallow | /football/tournaments/*/*/* |
Disallow | *?matchList= |
Disallow | *?blank=true |
Disallow | /cdn-cgi/ |
Disallow | /count-live-matches |
Disallow | /get-my-games-data |
Disallow | *tab%3D* |
Disallow | /rating/comments/* |
Other Records
Field | Value |
---|---|
sitemap | https://skor-express.com/sitemap.xml |