Log In Sign Up

ace.edu
robots.txt

Robots Exclusion Standard data for ace.edu

Resource Scan

Scan Details

Site Domain ace.edu
Base Domain ace.edu
Scan Status Ok
Last Scan2025-06-21T21:28:08+00:00
Next Scan 2025-07-21T21:28:08+00:00

Last Scan

Scanned2025-06-21T21:28:08+00:00
URL https://ace.edu/robots.txt
Domain IPs 141.193.213.20, 141.193.213.21
Response IP 141.193.213.21
Found Yes
Hash 93a4b6ad43ed2a90e7fd20f76c1fed6c498a7f45d41eededd100682bf9ac6104
SimHash 4bb613408d1f

Groups

*

Rule Path
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php
Disallow /?*
Disallow /programs/?*

googlebot

Rule Path
Allow /

bingbot

Rule Path
Allow /

slurp

Product Comment
slurp Yahoo
Rule Path
Allow /

duckduckbot

Rule Path
Allow /

applebot

Rule Path
Allow /

adsbot-google

Rule Path
Allow /

adsbot-google-mobile

Rule Path
Allow /

msnbot-media

Product Comment
msnbot-media Bing Ads
Rule Path
Allow /

yahoo! ad bot

Rule Path
Allow /

pinterestbot

Rule Path
Allow /

redditbot

Rule Path
Allow /

gptbot

Product Comment
gptbot OpenAI
Rule Path
Allow /

chatgpt-user

Product Comment
chatgpt-user OpenAI web browsing
Rule Path
Allow /

claudebot

Product Comment
claudebot Anthropic
Rule Path
Allow /

anthropic-ai

Rule Path
Allow /

ccbot

Product Comment
ccbot Common Crawl (used by many AI models)
Rule Path
Allow /

facebookexternalhit

Product Comment
facebookexternalhit Meta
Rule Path
Allow /

facebot

Product Comment
facebot Meta AI
Rule Path
Allow /

applebot

Product Comment
applebot Siri, Spotlight, AI features
Rule Path
Allow /

amazonbot

Rule Path
Allow /

alexamediabot

Product Comment
alexamediabot Amazon Alexa
Rule Path
Allow /

gemini

Product Comment
gemini Google AI (assumed name)
Rule Path
Allow /

google-extended

Product Comment
google-extended Google's AI data crawler
Rule Path
Allow /

copilot

Product Comment
copilot Microsoft Copilot
Rule Path
Allow /

perplexitybot

Product Comment
perplexitybot Perplexity AI
Rule Path
Allow /

aibot

Product Comment
aibot General AI bot identifier
Rule Path
Allow /
Back to top

Other Records

Field Value
sitemap https://ace.edu/sitemap_index.xml
Back to top

Comments

  • START YOAST BLOCK
  • ---------------------------
  • ---------------------------
  • END YOAST BLOCK
  • ---------------------------------
  • Explicitly allowed search crawlers
  • ---------------------------------
  • ---------------------------------
  • Explicitly allowed ad crawlers
  • ---------------------------------
  • ---------------------------------
  • Explicitly allowed AI crawlers
  • ---------------------------------
Back to top