japan.cnet.com
robots.txt

Robots Exclusion Standard data for japan.cnet.com

Resource Scan

Scan Details

Site Domain japan.cnet.com
Base Domain cnet.com
Scan Status Ok
Last Scan2024-05-16T19:59:43+00:00
Next Scan 2024-05-23T19:59:43+00:00

Last Scan

Scanned2024-05-16T19:59:43+00:00
URL https://japan.cnet.com/robots.txt
Domain IPs 101.102.235.200, 202.79.240.201, 202.79.241.200
Response IP 202.79.241.200
Found Yes
Hash b9f9e136f6943b748e92824faf8d38f52aeea41a7a2b1e39f737ef6b5ff43fb9
SimHash e93110044d95

Groups

*

Rule Path
Disallow /hotspot/
Disallow /direct/
Disallow /ads/

Other Records

Field Value
sitemap https://japan.cnet.com/sitemap/xml_sitemap.htm