controlscentral.com
robots.txt

Robots Exclusion Standard data for controlscentral.com

Resource Scan

Scan Details

Site Domain controlscentral.com
Base Domain controlscentral.com
Scan Status Ok
Last Scan2025-06-19T02:09:44+00:00
Next Scan 2025-07-19T02:09:44+00:00

Last Scan

Scanned2025-06-19T02:09:44+00:00
URL https://controlscentral.com/robots.txt
Domain IPs 104.26.12.82, 104.26.13.82, 172.67.74.194, 2606:4700:20::681a:c52, 2606:4700:20::681a:d52, 2606:4700:20::ac43:4ac2
Response IP 172.67.74.194
Found Yes
Hash dfe84d1f325c216fd5290587a444baa6ab26e72e3c4fe370cf6c211a1daf0ba5
SimHash b10b195bc101

Groups

*

Rule Path Comment
Allow / -
Disallow /Login.aspx -
Disallow /register.aspx -
Disallow /Default.aspx?ctl=Login -
Disallow /Default.aspx?ctl=Register -
Disallow /Default.aspx?ctl=Privacy -
Disallow /Default.aspx?ctl=Terms -
Disallow /Default.aspx?ctl=SendPassword -
Disallow /admin/ -
Disallow /App_Browsers/ -
Disallow /App_Code/ -
Disallow /App_Data/ -
Disallow /App_GlobalResources/ -
Disallow /bin/ -
Disallow /Components/ -
Disallow /Config/ -
Disallow /contest/ -
Disallow /controls/ -
Disallow /Documentation/ -
Disallow /HttpModules/ -
Disallow /Install/ -
Disallow /js/ -
Disallow /Providers/ -
Disallow /Resources/ContentRotator/ -
Disallow /Resources/ControlPanel/ -
Disallow /Resources/Dashboard/ -
Disallow /Resources/FeedBrowser/ -
Disallow /Resources/OpenForceAd/ -
Disallow /Resources/Search/ -
Disallow /Resources/Shared/ -
Disallow /Resources/SkinWidgets/ -
Disallow /Resources/TabStrip/ -
Disallow /Resources/Widgets/ -
Disallow /Shipping/ -
Disallow /Activity-Feed/userId/ Do not index user profiles

amazonbot

Rule Path
Disallow /

anthropic-ai

Rule Path
Disallow /

applebot-extended

Rule Path
Disallow /

awariorssbot
awariosmartbot

Rule Path
Disallow /

barkrowler

Rule Path
Disallow /

bytespider

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

chatgpt-user

Rule Path
Disallow /

claudebot

Rule Path
Disallow /

claude-web

Rule Path
Disallow /

cohere-ai

Rule Path
Disallow /

dataforseobot

Rule Path
Disallow /

diffbot

Rule Path
Disallow /

facebookbot

Rule Path
Disallow /

friendlycrawler

Rule Path
Disallow /

google-cloudvertexbot

Rule Path
Disallow /

google-extended

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

imagesiftbot

Rule Path
Disallow /

magpie-crawler

Rule Path
Disallow /

meta-externalagent
meta-externalagent

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

newsnow

Rule Path
Disallow /

news-please

Rule Path
Disallow /

oai-searchbot

Rule Path
Disallow /

omgili

Rule Path
Disallow /

omgilibot

Rule Path
Disallow /

peer39_crawler
peer39_crawler/1.0

Rule Path
Disallow /

perplexitybot

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

quora-bot

Rule Path
Disallow /

scrapy

Rule Path
Disallow /

turnitinbot

Rule Path
Disallow /

etaospider

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

yepbot

Rule Path
Disallow /

Other Records

Field Value
sitemap http://www.controlscentral.com/sitemap.aspx

Comments

  • Disallow Rules