Log In Sign Up

rapawalk.com
robots.txt

Robots Exclusion Standard data for rapawalk.com

Resource Scan

Scan Details

Site Domain rapawalk.com
Base Domain rapawalk.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-10-23T10:40:29+00:00
Next Scan 2026-01-21T10:40:29+00:00

Last Successful Scan

Scanned2023-03-15T23:21:12+00:00
URL https://rapawalk.com/robots.txt
Domain IPs 104.21.85.184, 172.67.208.228, 2606:4700:3030::6815:55b8, 2606:4700:3035::ac43:d0e4
Response IP 172.67.208.228
Found Yes
Hash 346ebc4d57cb87e8bde0fb273c4ce355823971987eaa955b98e911d6842867e3
SimHash 262073758ff7

Groups

*

Rule Path
Disallow /manager/
Back to top

Comments

  • Robots.txt for Rapawalk Fashion Technologies
  • GENERAL SETTINGS
  • Enables robots.txt rules for all crawlers
  • Crawl-delay parameter: the number of seconds you want to wait between successful requests to the same server.
  • Set a crawl rate, if your server's traffic problems. Please note that Google ignore crawl-delay setting in Robots.txt. You can set up this in Google Webmaster tool
  • Crawl-delay: 30
  • Rapawalk sitemap: URL to your sitemap file
  • Sitemap: https://www.rapawalk.com/sitemap.xml
  • Settings that relate to the UNDER CONSTRUCTION
  • Do not allow indexing files and folders that are required during development: CVS, SVN directory and dump files
  • Disallow: / CVS
  • Disallow: / *. Svn $
  • Disallow: / *. Idea $
  • Disallow: / *. Sql $
  • Disallow: / *. Tgz $
  • GENERAL SETTINGS For RAPAWALK
  • Do not index the page Rapawalk admin
  • Do not index the general technical Rapawalk directory
  • Disallow: / app /
  • Disallow: / downloader /
  • Disallow: / errors /
  • Disallow: / includes /
  • Disallow: / lib /
  • Disallow: / pkginfo /
  • Disallow: / shell /
  • Disallow: / var /
  • Do not index the shared files Rapawalk
  • RAPAWALK SEA IMPROVEMENT
  • Do not index the page subcategories that are sorted or filtered.
  • Disallow: / *? Dir *
  • Disallow: / *? Dir = desc
  • Disallow: / *? Dir = asc
  • Disallow: / *? Limit = all
  • Disallow: / *? Mode *
  • Do not index the second copy of the home page (example.com / index.php /). Un-comment only if you have activated Rapawalk SEO URLs.
  • Disallow: / index.php /
  • Do not index the link from the session ID
  • Disallow: / *? SID =
  • Do not index the page checkout and user account
  • Disallow: / checkout /
  • Disallow: / onestepcheckout /
  • Disallow: / customer /
  • Disallow: / customer / account /
  • Disallow: / customer / account / login /
  • Do not index the search page and CEO, non-optimized link categories
  • Server Settings
  • Do not index the general technical directories and files on a server
  • SETTINGS Image indexing
  • Optional: If you do not want to Google and Bing to index your images
  • User-agent: Googlebot-Image
  • Disallow: /
  • User-agent: msnbot-media
  • Disallow: /
Back to top