adformacademy.com
robots.txt

Robots Exclusion Standard data for adformacademy.com

Resource Scan

Scan Details

Site Domain adformacademy.com
Base Domain adformacademy.com
Scan Status Ok
Last Scan2025-08-12T19:13:18+00:00
Next Scan 2025-08-26T19:13:18+00:00

Last Scan

Scanned2025-08-12T19:13:18+00:00
URL https://adformacademy.com/robots.txt
Redirect https://www.adformacademy.com:443/robots.txt
Redirect Domain www.adformacademy.com
Redirect Base adformacademy.com
Domain IPs 75.2.74.207, 99.83.137.249
Redirect IPs 34.243.5.164, 52.215.80.60, 52.51.0.22
Response IP 52.51.0.22
Found Yes
Hash e4770229333d4925e22efa0271d6c62d12b97e5909d53f1b6c8dfda116496500
SimHash c24051455775

Groups

twitterbot

Rule Path
Disallow

*

Rule Path
Allow /student/path/*
Allow /student/activity/*

Comments

  • See http://www.robotstxt.org/robotstxt.html for documentation on how to use the robots.txt file
  • Required for activities shared to Twitter, see https://dev.twitter.com/cards/getting-started "URL Crawling & Caching"