Log In Sign Up

simon.com
robots.txt

Robots Exclusion Standard data for simon.com

Resource Scan

Scan Details

Site Domain simon.com
Base Domain simon.com
Scan Status Ok
Last Scan2024-11-12T18:06:38+00:00
Next Scan 2024-11-19T18:06:38+00:00

Last Scan

Scanned2024-11-12T18:06:38+00:00
URL https://simon.com/robots.txt
Redirect https://www.simon.com/robots.txt
Redirect Domain www.simon.com
Redirect Base simon.com
Domain IPs 20.69.216.13
Redirect IPs 116.51.25.100, 116.51.25.101, 116.51.25.102, 116.51.25.99
Response IP 116.51.25.102
Found Yes
Hash 3d01eb4141b8f527d34dade5f59525075fdd385349077db8c84e889121863990
SimHash f419111387b5

Groups

amazonbot
anthropic-ai
applebot-extended
bytespider
ccbot
chatgpt-user
claudebot
claude-web
cohere-ai
diffbot
facebookbot
friendlycrawler
google-extended
googleother
googleother-image
googleother-video
gptbot
imagesiftbot
img2dataset
omgili
omgilibot
perplexitybot
youbot

Rule Path
Disallow /

*

Rule Path
Disallow /about_simon/RadControls/
Disallow /brand/
Disallow /contentstream/
Disallow /contentstreamcsi/
Disallow /email/rscdealemailcreate/
Disallow /errors/
Disallow /retailpromotions/passwordrequirements.html
Disallow /retailshowcase/reporting/PrintAllRSCOffers.aspx
Disallow /system/
Disallow /volume/blank.aspx
Disallow /volume/help.aspx
Disallow /wifi/
Disallow /mall/*/directions/
Disallow /mall/*/directions
Disallow /sms-opt-in/
Disallow /email/*
Disallow /mall/*/stores/print/*
Disallow /bot-challenge
Back to top

Other Records

Field Value
sitemap https://www.simon.com/sitemap.xml
Back to top

Comments

  • Simon content is made available for your personal, non-commercial
  • use and is subject to our Terms of Use which prohibit commercial use of any information on this site:
  • https://www.simon.com/legal
  • Use of any device, tool, or process designed to data mine or scrape the content
  • using automated means is prohibited without prior written permission from
  • Simon Media Properties, or itsÂ’ parent Simon Property Group, Inc. Prohibited uses include but are not limited to:
  • (1) text and data mining activities under Art. 4 of the EU Directive on Copyright in the Digital Single Market;
  • (2) the development of any software, machine learning, artificial intelligence (AI), and/or large language models (LLMs);
  • (3) creating or providing archived or cached data sets containing our content to others; and/or
  • (4) any commercial purposes.
Back to top