sports.news.nate.com
robots.txt

Robots Exclusion Standard data for sports.news.nate.com

Resource Scan

Scan Details

Site Domain sports.news.nate.com
Base Domain nate.com
Scan Status Ok
Last Scan2024-05-22T14:32:57+00:00
Next Scan 2024-06-21T14:32:57+00:00

Last Scan

Scanned2024-05-22T14:32:57+00:00
URL https://sports.news.nate.com/robots.txt
Domain IPs 117.53.117.12
Response IP 117.53.117.12
Found Yes
Hash 1fd1bfc66aa8881b35d6594ec9a642d85d1722ee31b26d0380631bc6288fb295
SimHash 6945d0000371

Groups

*

Rule Path
Disallow /
Allow /ads.txt
Disallow /view/summary*

mediapartners-google
twitterbot

Rule Path
Allow /view/*
Allow /View/*
Disallow /view/summary*

googlebot
yeti
daum
bingbot
msnbot
zumbot
facebookexternalhit

Rule Path
Allow /
Disallow /view/summary*

gptbot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://sports.news.nate.com/sitemap?data=index