Log In Sign Up

recharge.com
robots.txt

Robots Exclusion Standard data for recharge.com

Resource Scan

Scan Details

Site Domain recharge.com
Base Domain recharge.com
Scan Status Ok
Last Scan2024-09-20T07:42:48+00:00
Next Scan 2024-10-04T07:42:48+00:00

Last Scan

Scanned2024-09-20T07:42:48+00:00
URL https://recharge.com/robots.txt
Redirect https://www.recharge.com/robots.txt
Redirect Domain www.recharge.com
Redirect Base recharge.com
Domain IPs 13.33.30.101, 13.33.30.127, 13.33.30.6, 13.33.30.71, 2600:9000:229f:1800:1:65cb:92c0:93a1, 2600:9000:229f:1a00:1:65cb:92c0:93a1, 2600:9000:229f:5000:1:65cb:92c0:93a1, 2600:9000:229f:6a00:1:65cb:92c0:93a1, 2600:9000:229f:7e00:1:65cb:92c0:93a1, 2600:9000:229f:a600:1:65cb:92c0:93a1, 2600:9000:229f:b600:1:65cb:92c0:93a1, 2600:9000:229f:e200:1:65cb:92c0:93a1
Redirect IPs 2600:9000:20fe:2800:8:e466:f800:93a1, 2600:9000:20fe:3c00:8:e466:f800:93a1, 2600:9000:20fe:5200:8:e466:f800:93a1, 2600:9000:20fe:5600:8:e466:f800:93a1, 2600:9000:20fe:5c00:8:e466:f800:93a1, 2600:9000:20fe:8000:8:e466:f800:93a1, 2600:9000:20fe:8e00:8:e466:f800:93a1, 2600:9000:20fe:da00:8:e466:f800:93a1, 52.222.144.117, 52.222.144.46, 52.222.144.83, 52.222.144.90
Response IP 18.165.140.124
Found Yes
Hash c259a716647936483eb648cab4b86465242609185b7c2c3eab82e2fa65e2fa74
SimHash 2a8d4d174150

Groups

*

Rule Path
Disallow /checkout
Disallow /cart
Disallow /orders
Disallow /user
Disallow /account
Disallow /password
Disallow /api
Allow /api/client/countries
Allow /api/client/pages
Allow /api/client/taxons
Allow /api/client/products
Back to top

Other Records

Field Value
sitemap https://www.recharge.com/sitemap.xml
Back to top

Comments

  • See http://www.robotstxt.org/robotstxt.html for documentation on how to use the robots.txt file
  • To ban all spiders from the entire site uncomment the next two lines:
  • User-agent: *
  • Disallow: /
Back to top