Log In Sign Up

ashelper.com
robots.txt

Robots Exclusion Standard data for ashelper.com

Resource Scan

Scan Details

Site Domain ashelper.com
Base Domain ashelper.com
Scan Status Ok
Last Scan2026-03-09T10:22:07+00:00
Next Scan 2026-03-16T10:22:07+00:00

Last Scan

Scanned2026-03-09T10:22:07+00:00
URL https://ashelper.com/robots.txt
Domain IPs 51.161.209.19
Response IP 51.161.209.19
Found Yes
Hash 0de3d9af943ae467884fe0222ba977802830ff44b4f57137426de61ec1db1551
SimHash 6705de51c694

Groups

*

Rule Path
Allow /
Disallow /admin/
Disallow /private/
Disallow /tmp/
Disallow /*.php$
Disallow /cgi-bin/

googlebot

Rule Path
Allow /
Disallow /admin/

bingbot

Rule Path
Allow /
Disallow /admin/

Other Records

Field Value
crawl-delay 2

slurp

Rule Path
Allow /

Other Records

Field Value
crawl-delay 3
Back to top

Other Records

Field Value
sitemap https://ashelper.com/sitemap.xml
Back to top

Comments

  • ═══════════════════════════════════════════════
  • ASHELPER.COM — robots.txt
  • Optimized for Google, Bing, and all major bots
  • ═══════════════════════════════════════════════
  • Allow all crawlers
  • Allow Googlebot explicitly
  • Allow Bingbot explicitly
  • Allow Slurp (Yahoo)
  • Sitemap location
  • Host directive (helps Bing)
Back to top

Warnings

  • `host` is not a known field.
Back to top