en.news.sports101.com
robots.txt

Robots Exclusion Standard data for en.news.sports101.com

Resource Scan

Scan Details

Site Domain en.news.sports101.com
Base Domain sports101.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't connect to server.
Last Scan2024-03-13T14:44:56+00:00
Next Scan 2024-06-11T14:44:56+00:00

Last Successful Scan

Scanned2023-05-12T23:36:07+00:00
URL https://en.news.sports101.com/robots.txt
Domain IPs 104.21.93.222, 172.67.216.78, 2606:4700:3032::6815:5dde, 2606:4700:3036::ac43:d84e
Response IP 104.21.93.222
Found Yes
Hash dae44921c51cc5e330aaba7d7260b2a4a9ba371cd22e81a5b9f7d7957aa3e1eb
SimHash 88001b6087b3

Groups

adsbot-google

Rule Path
Disallow

grapeshot

Rule Path
Disallow

*

Rule Path
Allow /

Other Records

Field Value
sitemap https://www.news.sports101.com/sitemap.xml