24techniquesforclosingthesale.com
robots.txt

Robots Exclusion Standard data for 24techniquesforclosingthesale.com

Resource Scan

Scan Details

Site Domain 24techniquesforclosingthesale.com
Base Domain 24techniquesforclosingthesale.com
Scan Status Ok
Last Scan7/23/2025, 7:13:15 AM
Next Scan 7/30/2025, 7:13:15 AM

Last Scan

Scanned7/23/2025, 7:13:15 AM
URL https://24techniquesforclosingthesale.com/robots.txt
Redirect https://www.24techniquesforclosingthesale.com/robots.txt
Redirect Domain www.24techniquesforclosingthesale.com
Redirect Base 24techniquesforclosingthesale.com
Domain IPs 104.21.44.82, 172.67.197.227, 2606:4700:3032::ac43:c5e3, 2606:4700:3035::6815:2c52
Redirect IPs 104.21.44.82, 172.67.197.227, 2606:4700:3032::ac43:c5e3, 2606:4700:3035::6815:2c52
Response IP 172.67.197.227
Found Yes
Hash 70b3a7f9fd3d8989b440a6878ded9c0654c4dabc200eb6ad8c774caac1bd580c
SimHash 62a0fa54ac92

Groups

*

Rule Path
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php
Disallow /search
Disallow /wp-content/plugins/
Disallow /feed
Disallow /*/feed
Disallow /*/*/feed

oai-searchbot
chatgpt-user
perplexitybot
firecrawlagent
andibot
exabot
phindbot
youbot

Rule Path
Allow /

gptbot
ccbot
google-extended

Rule Path
Disallow /

googlebot
bingbot

Rule Path
Allow /

googlebot-image

Rule Path
Allow /wp-content/uploads/

Other Records

Field Value
sitemap https://www.24techniquesforclosingthesale.com/sitemap_index.xml

Comments

  • Allow AI search and agent use
  • Disallow AI training data collection
  • Allow traditional search indexing