Log In Sign Up

atisfyre.com
robots.txt

Robots Exclusion Standard data for atisfyre.com

Resource Scan

Scan Details

Site Domain atisfyre.com
Base Domain atisfyre.com
Scan Status Ok
Last Scan2025-10-05T23:36:20+00:00
Next Scan 2025-10-19T23:36:20+00:00

Last Scan

Scanned2025-10-05T23:36:20+00:00
URL https://atisfyre.com/robots.txt
Domain IPs 3.170.229.18, 3.170.229.39, 3.170.229.87, 3.170.229.92
Response IP 3.170.229.18
Found Yes
Hash 83a0d919a06b86db6c791809609839da8c291c2be998bbcb9ae0722a4545e62a
SimHash 64949b10c3e4

Groups

*

Rule Path
Disallow /assets/
Disallow /environment/
Disallow /node_modules/
Disallow /*.ts$
Disallow /*.json$
Allow /

Other Records

Field Value
crawl-delay 10

badbot

Rule Path
Disallow /

evilcrawler

Rule Path
Disallow /

googlebot

Rule Path
Allow /

bingbot

Rule Path
Allow /

gptbot

Rule Path
Allow /

claudebot

Rule Path
Allow /

perplexitybot

Rule Path
Allow /

chatgpt-user

Rule Path
Allow /

meta-externalagent

Rule Path
Allow /

amazonbot

Rule Path
Allow /

applebot

Rule Path
Allow /
Back to top

Other Records

Field Value
sitemap https://atisfyre.com/sitemap.xml
Back to top

Comments

  • Block access to sensitive files and directories
  • Allow access to everything else
  • Crawl delay to prevent server overload (Optional, some bots respect this)
  • Block known malicious bots (Add more as needed)
  • Block bots without a user-agent (blank user-agent)
  • Optional: Link to your XML sitemap
Back to top

Warnings

  • 2 invalid lines.
Back to top