spiceupyourblog.com
robots.txt

Robots Exclusion Standard data for spiceupyourblog.com

Resource Scan

Scan Details

Site Domain spiceupyourblog.com
Base Domain spiceupyourblog.com
Scan Status Ok
Last Scan2025-09-01T12:55:59+00:00
Next Scan 2025-10-01T12:55:59+00:00

Last Scan

Scanned2025-09-01T12:55:59+00:00
URL https://spiceupyourblog.com/robots.txt
Redirect https://www.spiceupyourblog.com/robots.txt
Redirect Domain www.spiceupyourblog.com
Redirect Base spiceupyourblog.com
Domain IPs 2a02:4780:84:db56:916b:d2f1:2b29:3724, 2a02:4780:84:ddce:f1a1:ee28:d640:f0de, 84.32.84.155, 84.32.84.180
Redirect IPs 2a02:4780:84:3260:94da:ceee:ed71:aa66, 2a02:4780:84:79c5:e3ce:e086:55b7:c5fc, 77.37.48.167, 91.108.100.250
Response IP 93.127.196.225
Found Yes
Hash 9929f7b9ddab10e471259c4d4de31b5f1cdd2542c800941ea00621f3256897da
SimHash 62303054cdf5

Groups

oai-searchbot
chatgpt-user
perplexitybot
firecrawlagent
andibot
exabot
phindbot
youbot

Rule Path
Allow /

gptbot
ccbot
google-extended

Rule Path
Disallow /

googlebot
bingbot

Rule Path
Allow /

*

Rule Path
Allow /

Other Records

Field Value
sitemap https://www.spiceupyourblog.com/sitemap_index.xml

Comments

  • Allow AI search and agent use
  • Disallow AI training data collection
  • Allow traditional search indexing