marquee.gs.com
robots.txt

Robots Exclusion Standard data for marquee.gs.com

Resource Scan

Scan Details

Site Domain marquee.gs.com
Base Domain gs.com
Scan Status Ok
Last Scan2024-09-21T15:12:24+00:00
Next Scan 2024-10-05T15:12:24+00:00

Last Scan

Scanned2024-09-21T15:12:24+00:00
URL https://marquee.gs.com/robots.txt
Domain IPs 23.32.29.88, 23.32.29.89
Response IP 23.32.29.88
Found Yes
Hash 8329e16876ebd3e5d9345e2cc2d7f9eabfdb032696adbc3b2af926c8c8432214
SimHash ec10cac067d3

Groups

googlebot-image
googlebot-video

Rule Path
Disallow /

*

Rule Path
Disallow /desktop/
Disallow /platforms/

Comments

  • Everything is allowed by default
  • Block google image/video search and adbots
  • https://developers.google.com/search/reference/robots_txt
  • Block /desktop/,/platforms/ from all crawlers