sport24.gr
robots.txt

Robots Exclusion Standard data for sport24.gr

Resource Scan

Scan Details

Site Domain sport24.gr
Base Domain sport24.gr
Scan Status Ok
Last Scan2024-05-21T23:43:16+00:00
Next Scan 2024-05-28T23:43:16+00:00

Last Scan

Scanned2024-05-21T23:43:16+00:00
URL https://sport24.gr/robots.txt
Redirect https://www.sport24.gr/robots.txt
Redirect Domain www.sport24.gr
Redirect Base sport24.gr
Domain IPs 104.18.4.126, 104.18.5.126, 2606:4700::6812:47e, 2606:4700::6812:57e
Redirect IPs 104.18.4.126, 104.18.5.126, 2606:4700::6812:47e, 2606:4700::6812:57e
Response IP 104.18.4.126
Found Yes
Hash 6e579adc11cbe65e85decf02928d7373fe16aceb2527278a0b2acaa13c8c48a0
SimHash 630cd055c331

Groups

*

Rule Path
Allow /

msnbot

Rule Path
Allow /

Other Records

Field Value
crawl-delay 5

Other Records

Field Value
sitemap https://www.sport24.gr/news.xml
sitemap https://www.sport24.gr/sitemap.xml
sitemap https://www.sport24.gr/sitemap.xml