appsphinx.com
robots.txt

Robots Exclusion Standard data for appsphinx.com

Resource Scan

Scan Details

Site Domain appsphinx.com
Base Domain appsphinx.com
Scan Status Ok
Last Scan2025-08-19T23:44:45+00:00
Next Scan 2025-09-18T23:44:45+00:00

Last Scan

Scanned2025-08-19T23:44:45+00:00
URL https://appsphinx.com/robots.txt
Domain IPs 104.21.94.139, 172.67.136.139, 2606:4700:3030::ac43:888b, 2606:4700:3036::6815:5e8b
Response IP 172.67.136.139
Found Yes
Hash e4889257822ee23b3343c826aa867672ba6c095818b6a5beb77b024c8a2df9a2
SimHash 3d0cc8e3fea1

Groups

*

Rule Path
Allow /
Allow /feed/
Allow /vault/
Allow /developer/
Allow /levelup/
Allow /contact/
Allow /privacy-policy/
Disallow /admin/
Disallow /private/
Disallow /_assets/
Disallow /.obsidian/
Disallow /_Error_Solution_Log/
Allow /content/
Allow /static/
Allow /*.js
Allow /*.css
Allow /*.png
Allow /*.jpg
Allow /*.jpeg
Allow /*.gif
Allow /*.svg
Allow /*.webp
Allow /*.ico
Allow /*.xml

Other Records

Field Value
crawl-delay 1

Other Records

Field Value
sitemap https://appsphinx.com/sitemap.xml

Comments

  • Sitemap
  • Crawl-delay for respectful crawling
  • Allow all content
  • Disallow admin or private areas (if any)
  • Disallow private content
  • Allow important static files