Log In Sign Up

advastore.com
robots.txt

Robots Exclusion Standard data for advastore.com

Resource Scan

Scan Details

Site Domain advastore.com
Base Domain advastore.com
Scan Status Ok
Last Scan2024-11-15T00:45:23+00:00
Next Scan 2024-12-15T00:45:23+00:00

Last Scan

Scanned2024-11-15T00:45:23+00:00
URL https://advastore.com/robots.txt
Redirect https://www.advastore.com/robots.txt
Redirect Domain www.advastore.com
Redirect Base advastore.com
Domain IPs 75.2.70.75, 99.83.190.102
Redirect IPs 52.197.0.54, 52.199.221.217, 54.178.223.218
Response IP 54.178.223.218
Found Yes
Hash a0d6b4a9a6536c944ccf7f19b713e4bdaa86bee492379cb58b32be11a78c01b6
SimHash 6112c85545d4

Groups

*

Rule Path
Disallow /cgi-bin/
Disallow /temp/
Disallow /private/
Disallow /backend/
Disallow /admin/
Disallow /api/
Disallow /test/
Disallow /dev/
Disallow /staging/
Disallow /uploads/
Disallow /backup/
Disallow /logs/
Disallow /drafts/
Back to top

Other Records

Field Value
sitemap https://www.advastore.com/sitemap.xml
sitemap https://www.advastore.com/sitemap.xml
Back to top

Comments

  • Allow search engines to access the sitemap
  • Block specific web robots from accessing the site
  • Uncomment the following lines if needed
  • User-agent: BadBot
  • Disallow: /
  • Delay for 10 seconds between successive requests (optional and might not be respected by all bots)
  • Crawl-delay: 10
Back to top