Log In Sign Up

snapedcodecampus.tech
robots.txt

Robots Exclusion Standard data for snapedcodecampus.tech

Resource Scan

Scan Details

Site Domain snapedcodecampus.tech
Base Domain snapedcodecampus.tech
Scan Status Ok
Last Scan2025-06-14T09:31:29+00:00
Next Scan 2025-06-21T09:31:29+00:00

Last Scan

Scanned2025-06-14T09:31:29+00:00
URL https://snapedcodecampus.tech/robots.txt
Domain IPs 104.21.11.155, 172.67.166.97, 2606:4700:3035::ac43:a661, 2606:4700:3036::6815:b9b
Response IP 172.67.166.97
Found Yes
Hash 4899410be26df13d677b6b0b939fce767711cf3b0ed644901b7007b2a3ba3513
SimHash 65440b526582

Groups

*

Rule Path Comment
Disallow /private/ Block specific private folder (optional)
Disallow /login/ Block login page (optional)

googlebot

Rule Path
Disallow

bingbot

Rule Path
Disallow
Disallow /search/
Disallow /cart/
Disallow /checkout/

*

Rule Path
Disallow /admin/
Disallow /backend/
Back to top

Other Records

Field Value
sitemap https://snapedcodecampus.tech/sitemap.xml
Back to top

Comments

  • Allow all web crawlers to access the entire site
  • Allow Googlebot (Google's crawler) to access all pages
  • Allow Bingbot (Bing's crawler) to access all pages
  • Block duplicate or unnecessary content (optional)
  • Sitemap URL for search engines to crawl
  • Block crawlers from accessing admin or sensitive directories
Back to top