sportsfile.com
robots.txt

Robots Exclusion Standard data for sportsfile.com

Resource Scan

Scan Details

Site Domain sportsfile.com
Base Domain sportsfile.com
Scan Status Ok
Last Scan2024-05-31T02:42:15+00:00
Next Scan 2024-06-30T02:42:15+00:00

Last Scan

Scanned2024-05-31T02:42:15+00:00
URL https://sportsfile.com/robots.txt
Domain IPs 104.26.10.224, 104.26.11.224, 172.67.70.87, 2606:4700:20::681a:ae0, 2606:4700:20::681a:be0, 2606:4700:20::ac43:4657
Response IP 172.67.70.87
Found Yes
Hash ba6ad7ba3bb280f0430fc1c1cddb4396226390fa7eb5708bdda1d00f0757fd4e
SimHash 691898834e92

Groups

*

Rule Path
Allow /
Disallow /best-of-the-year/
Disallow /paralympic-2008/

Other Records

Field Value
sitemap http://www.sportsfile.com/xml_sitemaps/video_sitemap.xml

Comments

  • static file