Log In Sign Up

marchingstar.com
robots.txt

Robots Exclusion Standard data for marchingstar.com

Resource Scan

Scan Details

Site Domain marchingstar.com
Base Domain marchingstar.com
Scan Status Ok
Last Scan2025-09-23T12:49:24+00:00
Next Scan 2025-10-23T12:49:24+00:00

Last Scan

Scanned2025-09-23T12:49:24+00:00
URL https://marchingstar.com/robots.txt
Domain IPs 34.111.179.208
Response IP 34.111.179.208
Found Yes
Hash f39fa2c589f90503fa1d77398099b0b47ccf5cd29d8ebf19f644e0705f9c7da5
SimHash 6ca8cc52a7b1

Groups

*

Rule Path
Allow /
Disallow /admin/
Disallow /wp-admin/
Disallow /wp-content/
Disallow /*.php$
Disallow /cgi-bin/
Allow /
Allow /about
Allow /services
Allow /contact
Allow /blog

Other Records

Field Value
crawl-delay 1
Back to top

Other Records

Field Value
sitemap https://marchingstar.com/sitemap.xml
Back to top

Comments

  • Sitemap
  • Block common spam paths
  • Allow search engines to crawl important pages
  • Crawl delay (optional - helps with server load)
Back to top