Log In Sign Up

ilfusion.com
robots.txt

Robots Exclusion Standard data for ilfusion.com

Resource Scan

Scan Details

Site Domain ilfusion.com
Base Domain ilfusion.com
Scan Status Ok
Last Scan2025-06-30T05:07:05+00:00
Next Scan 2025-07-30T05:07:05+00:00

Last Scan

Scanned2025-06-30T05:07:05+00:00
URL https://ilfusion.com/robots.txt
Domain IPs 104.21.65.220, 172.67.193.107, 2606:4700:3031::6815:41dc, 2606:4700:3033::ac43:c16b
Response IP 172.67.193.107
Found Yes
Hash c6f35a68c9efbd22365301cef4d0a0c5e801f80b0e3af8e6f4df6f43a8e11f0f
SimHash 22f03ad5c5f6

Groups

*

Rule Path
Disallow /wp-admin
Disallow /ILFUSION-oldsite-backup
Disallow /email
Disallow /FBXs
Disallow /delete
Disallow /newsletters
Disallow /wp-comps
Disallow /staff/johndy/johndy
Disallow /?y=*
Disallow /?c=*
Disallow /*?y=*

oai-searchbot
chatgpt-user
perplexitybot
firecrawlagent
andibot
exabot
phindbot
youbot

Rule Path
Allow /

gptbot
ccbot
google-extended

Rule Path
Disallow /

googlebot
bingbot

Rule Path
Allow /
Disallow /admin/
Disallow /internal/
Back to top

Other Records

Field Value
sitemap https://www.ilfusion.com/sitemap_index.xml
Back to top

Comments

  • START YOAST BLOCK
  • ---------------------------
  • Allow AI search and agent use
  • Disallow AI training data collection
  • Allow traditional search indexing
  • Disallow access to admin areas for all bots
  • User-agent: *
  • ---------------------------
  • END YOAST BLOCK
Back to top