Log In Sign Up

cryptodisplay.io
robots.txt

Robots Exclusion Standard data for cryptodisplay.io

Resource Scan

Scan Details

Site Domain cryptodisplay.io
Base Domain cryptodisplay.io
Scan Status Ok
Last Scan2026-02-03T16:05:05+00:00
Next Scan 2026-02-10T16:05:05+00:00

Last Scan

Scanned2026-02-03T16:05:05+00:00
URL https://cryptodisplay.io/robots.txt
Domain IPs 3.165.102.112, 3.165.102.38, 3.165.102.59, 3.165.102.73
Response IP 3.165.102.38
Found Yes
Hash f40fc1e850280428fb0148a2dd186bdab35bf88516bb9575732db4e28ad85e8a
SimHash ed74ea4526e3

Groups

*

Rule Path
Allow /
Disallow /admin/
Disallow /login/
Disallow /register/
Disallow /vendor/
Disallow /storage/
Disallow /config/
Disallow /tests/
Disallow /bootstrap/
Disallow /resources/
Disallow /node_modules/
Disallow /composer.lock
Disallow /package-lock.json
Disallow /*.env$
Disallow /*.sql$
Disallow /*.zip$
Disallow /*.bak$
Disallow /*.git$
Disallow /*.yml$
Disallow /*.json$
Disallow /livewire/message/
Back to top

Other Records

Field Value
sitemap https://cryptodisplay.io/sitemap.xml
Back to top

Comments

  • Allow all bots to crawl public pages
  • Sitemap
  • Disallow sensitive or private areas
  • Block hidden or unsafe files
  • Optional: reduce crawl load on AJAX endpoints (Livewire requests)
Back to top