enewspaper.mercurynews.com
robots.txt

Robots Exclusion Standard data for enewspaper.mercurynews.com

Resource Scan

Scan Details

Site Domain enewspaper.mercurynews.com
Base Domain mercurynews.com
Scan Status Ok
Last Scan2024-06-01T10:52:53+00:00
Next Scan 2024-07-01T10:52:53+00:00

Last Scan

Scanned2024-06-01T10:52:53+00:00
URL https://enewspaper.mercurynews.com/robots.txt
Domain IPs 13.33.30.27, 13.33.30.38, 13.33.30.84, 13.33.30.97, 2600:9000:229f:1000:11:b74f:2100:93a1, 2600:9000:229f:1800:11:b74f:2100:93a1, 2600:9000:229f:3800:11:b74f:2100:93a1, 2600:9000:229f:4000:11:b74f:2100:93a1, 2600:9000:229f:5800:11:b74f:2100:93a1, 2600:9000:229f:8000:11:b74f:2100:93a1, 2600:9000:229f:b800:11:b74f:2100:93a1, 2600:9000:229f:e00:11:b74f:2100:93a1
Response IP 13.33.30.84
Found Yes
Hash 328ee7d7c73c90ce4904471081dfcc8e80f712a6b47c2052e5e499eea480fa1a
SimHash cd155855e7d6

Groups

googlebot

Rule Path
Disallow /html5/reader/stage/

googlebot

Rule Path
Disallow /html5/desktop/stage/
Disallow /html5/desktop/production/

googlebot

Rule Path
Disallow /html5/mobile/stage/
Disallow /html5/mobile/production/

Comments

  • Group 1
  • Group 2
  • Group 3