amp.ncaa.com
robots.txt

Robots Exclusion Standard data for amp.ncaa.com

Resource Scan

Scan Details

Site Domain amp.ncaa.com
Base Domain ncaa.com
Scan Status Ok
Last Scan2024-05-23T23:47:35+00:00
Next Scan 2024-05-30T23:47:35+00:00

Last Scan

Scanned2024-05-23T23:47:35+00:00
URL https://amp.ncaa.com/robots.txt
Redirect https://www.ncaa.com/robots.txt
Redirect Domain www.ncaa.com
Redirect Base ncaa.com
Domain IPs 104.69.163.202, 2600:1413:b000:584::3134, 2600:1413:b000:595::3134
Redirect IPs 23.53.217.212, 2600:1413:b000:38e::3134, 2600:1413:b000:397::3134
Response IP 23.53.217.212
Found Yes
Hash de8b2422b0fe20a7643d356842e4f8ff0afa6e5293b8dff01f2c4b0acbeedfbf
SimHash 0b9425944232

Groups

*

Rule Path
Allow /core/*.css$
Allow /core/*.css?
Allow /core/*.js$
Allow /core/*.js?
Allow /core/*.gif
Allow /core/*.jpg
Allow /core/*.jpeg
Allow /core/*.png
Allow /core/*.svg
Disallow /core/
Disallow /README.txt
Disallow /web.config
Disallow /admin/
Disallow /comment/reply/
Disallow /filter/tips
Disallow /node/add/
Disallow /search/
Disallow /user/register
Disallow /user/password
Disallow /user/login
Disallow /user/logout
Disallow /index.php/admin/
Disallow /index.php/comment/reply/
Disallow /index.php/filter/tips
Disallow /index.php/node/add/
Disallow /index.php/search/
Disallow /index.php/user/password
Disallow /index.php/user/register
Disallow /index.php/user/login
Disallow /index.php/user/logout
Disallow /includes/
Disallow /core/
Disallow /misc/
Disallow /modules/
Disallow /CHANGELOG.txt
Disallow /cron.php
Disallow /INSTALL.mysql.txt
Disallow /INSTALL.pgsql.txt
Disallow /install.php
Disallow /INSTALL.txt
Disallow /LICENSE.txt
Disallow /MAINTAINERS.txt
Disallow /update.php
Disallow /UPGRADE.txt
Disallow /xmlrpc.php
Disallow /saml_login
Disallow /simplesaml
Disallow /imce
Disallow /?q=*
Disallow /nst-fa/
Disallow /index.php
Disallow /index.php/*
Allow /sites/default/files/external/assets/
Allow /sites/default/files/external/printable-bracket/
Allow /sites/default/files/external/gametool/brackets/
Allow /sites/default/files/legacy/
Allow /modules/custom/*.css
Allow /modules/custom/*/css/
Allow /modules/custom/*/modules/*/css/
Allow /themes/custom/*/css/
Allow /modules/custom/*/img/
Allow /modules/custom/*/modules/*/img/
Allow /themes/custom/*/img/
Allow /themes/custom/*/assets/
Allow /modules/custom/*/js/
Allow /modules/custom/*/lib/
Allow /modules/custom/*/templates/compiled/
Allow /modules/custom/*/dist/
Allow /modules/custom/*/pkg/
Allow /themes/custom/*/js/
Allow /_ssr/live-updates/
Allow /_nuxt/
Allow /modules/custom/casablanca_libraries/

ccbot

Rule Path
Disallow /

chatgpt-user

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

google-extended

Rule Path
Disallow /

anthropic-ai

Rule Path
Disallow /

omgilibot

Rule Path
Disallow /

omgili

Rule Path
Disallow /

facebookbot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.ncaa.com/sites/default/files/public/sitemaps/article-sitemap.xml
sitemap https://www.ncaa.com/sites/default/files/public/sitemaps/brackets-sitemap.xml
sitemap https://www.ncaa.com/sites/default/files/public/sitemaps/superpage-sitemap.xml
sitemap https://www.ncaa.com/sites/default/files/public/sitemaps/video-sitemap.xml
sitemap https://www.ncaa.com/sites/default/files/public/sitemaps/page-sitemap.xml
sitemap https://www.ncaa.com/sites/default/files/public/sitemaps/iframe-sitemap.xml
sitemap https://www.ncaa.com/sites/default/files/public/sitemaps/ranking-sitemap.xml
sitemap https://www.ncaa.com/sites/default/files/public/sitemaps/layout_page-sitemap.xml
sitemap https://www.ncaa.com/sites/default/files/public/sitemaps/tabbed_content-sitemap.xml
sitemap https://www.ncaa.com/sites/default/files/public/sitemaps/history-sitemap.xml
sitemap https://www.ncaa.com/sitemap/news.xml
sitemap https://www.ncaa.com/sites/default/files/public/sitemaps/seo-sitemap.xml

Comments

  • CSS, JS, Images
  • Directories
  • Files
  • Paths (clean URLs)
  • Paths (no clean URLs)
  • Directories
  • Files
  • Paths (clean URLs)
  • Paths (no clean URLs)
  • old/migrated file sources
  • css
  • img
  • js
  • libraries
  • Sitemaps
  • AI User agents