hattrick.org
robots.txt

Robots Exclusion Standard data for hattrick.org

Resource Scan

Scan Details

Site Domain hattrick.org
Base Domain hattrick.org
Scan Status Ok
Last Scan2024-06-14T19:28:18+00:00
Next Scan 2024-06-21T19:28:18+00:00

Last Scan

Scanned2024-06-14T19:28:18+00:00
URL https://hattrick.org/robots.txt
Redirect https://www.hattrick.org/robots.txt
Redirect Domain www.hattrick.org
Redirect Base hattrick.org
Domain IPs 193.34.188.170, 193.34.188.171
Redirect IPs 193.34.188.170, 193.34.188.171
Response IP 193.34.188.170
Found Yes
Hash 29c8b93daa56a67257cdd4b3b24e8f3456adc36103f537e0c2c8d1c1e4e02951
SimHash af5c950f45f2

Groups

ias_crawler

Rule Path
Disallow /

ias_wombles

Rule Path
Disallow /

spiderling

Rule Path
Disallow /

sirdatabot

Rule Path
Disallow /

*

Rule Path
Disallow /Club/
Disallow /WebServices/
Allow /World/$
Allow /World/InternationalNews.aspx
Disallow /World/*
Disallow /Community/Tournaments
Disallow /Community/Federations
Disallow /*/Club/
Allow /*/World/$
Allow /*/World/InternationalNews.aspx
Disallow /*/World/*
Disallow /*/Community/Tournaments
Disallow /sq/Forum/
Disallow /ar/Forum/
Disallow /az/Forum/
Disallow /id/Forum/
Disallow /bs/Forum/
Disallow /bg/Forum/
Disallow /ca/Forum/
Disallow /cs/Forum/
Disallow /da/Forum/
Disallow /de/Forum/
Disallow /et/Forum/
Disallow /en-us/Forum/
Disallow /es/Forum/
Disallow /es-mx/Forum/
Disallow /es-ar/Forum/
Disallow /eu/Forum/
Disallow /fr/Forum/
Disallow /fy/Forum/
Disallow /fu/Forum/
Disallow /gl/Forum/
Disallow /ka/Forum/
Disallow /he/Forum/
Disallow /hr/Forum/
Disallow /is/Forum/
Disallow /it/Forum/
Disallow /lv/Forum/
Disallow /lb/Forum/
Disallow /lt/Forum/
Disallow /hu/Forum/
Disallow /nl/Forum/
Disallow /nn/Forum/
Disallow /nn-no/Forum/
Disallow /fa/Forum/
Disallow /pl/Forum/
Disallow /pt/Forum/
Disallow /pt-br/Forum/
Disallow /ro/Forum/
Disallow /sk/Forum/
Disallow /sl/Forum/
Disallow /fi/Forum/
Disallow /sv/Forum/
Disallow /vi/Forum/
Disallow /tr/Forum/
Disallow /vl/Forum/
Disallow /el/Forum/
Disallow /be/Forum/
Disallow /mk/Forum/
Disallow /ru/Forum/
Disallow /sr/Forum/
Disallow /uk/Forum/
Disallow /zh/Forum/
Disallow /ko/Forum/
Disallow /ja/Forum/
Disallow /en/Forum/
Disallow /*/Forum/*

Other Records

Field Value
sitemap https://www.hattrick.org/sitemap.xml