Log In Sign Up

tessawatkins.com
robots.txt

Robots Exclusion Standard data for tessawatkins.com

Resource Scan

Scan Details

Site Domain tessawatkins.com
Base Domain tessawatkins.com
Scan Status Ok
Last Scan2025-09-05T04:05:46+00:00
Next Scan 2025-10-05T04:05:46+00:00

Last Scan

Scanned2025-09-05T04:05:46+00:00
URL https://tessawatkins.com/robots.txt
Domain IPs 104.21.41.217, 172.67.152.9, 2606:4700:3036::6815:29d9, 2606:4700:3037::ac43:9809
Response IP 104.21.41.217
Found Yes
Hash 253fff610f2122a341288e5a69ae92732aeacb450d7b974b7bc5ee8100fa44cb
SimHash 61989ac4e5a5

Groups

gptbot
google-extended
ccbot
perplexitybot
anthropic-ai
claude-web
claudebot
facebookbot
omgili
omigilibot
bytedance
bytespider

Rule Path
Disallow /

imagesiftbot
diffbot

Rule Path
Disallow /

chatgpt-user
cohere-ai
googlebot
youbot
*

Rule Path
Disallow /?s=*
Disallow *?playAgain=*
Disallow /?locale=*
Disallow /aurise/
Disallow /email-signatures/
Disallow /wordpress-products/
Disallow /audit/
Disallow /tw-custom-feeds/
Disallow /custom-feeds/
Disallow /wp-admin/
Disallow /wp-includes/
Allow /wp-admin/admin-ajax.php
Allow /wp-includes/*.js*
Allow /wp-includes/*.css*
Allow /*.js*
Allow /*.css*
Allow /wp-content/*.css*
Allow /wp-content/plugins/*.css*
Allow /wp-content/plugins/*.js*
Allow /wp-content/plugins/*ajax*
Allow /wp-content/themes/*.css*
Allow /wp-content/themes/*.js*
Allow /wp-content/themes/*ajax*
Allow /wp-content/plugins/*/images/
Allow /wp-content/uploads/
Back to top

Other Records

Field Value
sitemap https://tessawatkins.com/sitemap_index.xml
Back to top

Comments

  • Robots.txt generated by AuRise Creative <https://aurisecreative.com>
  • Allow Indexing on tessawatkins.com
  • Disallow AI bots to use content for training
  • Tell those bots to stuff it
  • Disallow AI bots to scrape for images
  • Tell those image-sniffing bots to stuff it
  • Allowed User Agents
  • Disallow Search Queries
  • Disallow Video Control
  • Disallow Locale Queries
  • Custom Content
  • WordPress
  • Yoast SEO Sitemap
Back to top

Warnings

  • 1 invalid line.
Back to top