learningconsole.amazonadvertising.com
robots.txt

Robots Exclusion Standard data for learningconsole.amazonadvertising.com

Resource Scan

Scan Details

Site Domain learningconsole.amazonadvertising.com
Base Domain amazonadvertising.com
Scan Status Ok
Last Scan2024-05-24T05:38:00+00:00
Next Scan 2024-06-07T05:38:00+00:00

Last Scan

Scanned2024-05-24T05:38:00+00:00
URL https://learningconsole.amazonadvertising.com/robots.txt
Domain IPs 18.189.244.201, 18.223.103.116, 3.21.84.137
Response IP 18.223.103.116
Found Yes
Hash e4770229333d4925e22efa0271d6c62d12b97e5909d53f1b6c8dfda116496500
SimHash c24051455775

Groups

twitterbot

Rule Path
Disallow

*

Rule Path
Allow /student/path/*
Allow /student/activity/*

Comments

  • See http://www.robotstxt.org/robotstxt.html for documentation on how to use the robots.txt file
  • Required for activities shared to Twitter, see https://dev.twitter.com/cards/getting-started "URL Crawling & Caching"