Log In Sign Up

shoppop.com
robots.txt

Robots Exclusion Standard data for shoppop.com

Resource Scan

Scan Details

Site Domain shoppop.com
Base Domain shoppop.com
Scan Status Ok
Last Scan2024-05-02T19:21:47+00:00
Next Scan 2024-06-01T19:21:47+00:00

Last Scan

Scanned2024-05-02T19:21:47+00:00
URL https://shoppop.com/robots.txt
Redirect https://www.shoppop.com:443/robots.txt
Redirect Domain www.shoppop.com
Redirect Base shoppop.com
Domain IPs 13.226.228.109, 13.226.228.129, 13.226.228.66, 13.226.228.94, 2600:9000:2201:2200:13:9752:4200:93a1, 2600:9000:2201:3c00:13:9752:4200:93a1, 2600:9000:2201:5600:13:9752:4200:93a1, 2600:9000:2201:5a00:13:9752:4200:93a1, 2600:9000:2201:8600:13:9752:4200:93a1, 2600:9000:2201:9400:13:9752:4200:93a1, 2600:9000:2201:b800:13:9752:4200:93a1, 2600:9000:2201:bc00:13:9752:4200:93a1
Redirect IPs 18.161.6.109, 18.161.6.5, 18.161.6.54, 18.161.6.84, 2600:9000:2201:1c00:13:9752:4200:93a1, 2600:9000:2201:4800:13:9752:4200:93a1, 2600:9000:2201:4c00:13:9752:4200:93a1, 2600:9000:2201:7a00:13:9752:4200:93a1, 2600:9000:2201:a00:13:9752:4200:93a1, 2600:9000:2201:bc00:13:9752:4200:93a1, 2600:9000:2201:da00:13:9752:4200:93a1, 2600:9000:2201:dc00:13:9752:4200:93a1
Response IP 18.165.171.50
Found Yes
Hash 240bd3dd22f070d5b9284f4f9aee4d5bbc488648804b2eaf732fa661e14ba0e8
SimHash b2844d877570

Groups

ahrefssiteaudit

Rule Path
Allow /
Back to top

Comments

  • See http://www.robotstxt.org/robotstxt.html for documentation on how to use the robots.txt file
  • To ban all spiders from the entire site uncomment the next two lines:
  • User-agent: *
  • Disallow: /
Back to top