japan.cnet.com
robots.txt

Robots Exclusion Standard data for japan.cnet.com

Resource Scan

Scan Details

Site Domain japan.cnet.com
Base Domain cnet.com
Scan Status Ok
Last Scan2024-11-08T12:06:00+00:00
Next Scan 2024-11-15T12:06:00+00:00

Last Scan

Scanned2024-11-08T12:06:00+00:00
URL https://japan.cnet.com/robots.txt
Domain IPs 101.102.235.200, 111.108.184.200, 202.247.51.200
Response IP 202.247.51.200
Found Yes
Hash b9f9e136f6943b748e92824faf8d38f52aeea41a7a2b1e39f737ef6b5ff43fb9
SimHash e93110044d95

Groups

*

Rule Path
Disallow /hotspot/
Disallow /direct/
Disallow /ads/

Other Records

Field Value
sitemap https://japan.cnet.com/sitemap/xml_sitemap.htm