shoesonclearance.com
robots.txt

Robots Exclusion Standard data for shoesonclearance.com

Resource Scan

Scan Details

Site Domain shoesonclearance.com
Base Domain shoesonclearance.com
Scan Status Ok
Last Scan2024-09-23T09:26:15+00:00
Next Scan 2024-09-30T09:26:15+00:00

Last Scan

Scanned2024-09-23T09:26:15+00:00
URL https://shoesonclearance.com/robots.txt
Redirect https://www.shoesonclearance.com/robots.txt
Redirect Domain www.shoesonclearance.com
Redirect Base shoesonclearance.com
Domain IPs 108.156.133.113, 108.156.133.37, 108.156.133.98, 108.156.133.99
Redirect IPs 108.156.133.113, 108.156.133.37, 108.156.133.98, 108.156.133.99, 2600:9000:2755:1e00:1c:e59:4580:93a1, 2600:9000:2755:3a00:1c:e59:4580:93a1, 2600:9000:2755:4200:1c:e59:4580:93a1, 2600:9000:2755:5400:1c:e59:4580:93a1, 2600:9000:2755:5800:1c:e59:4580:93a1, 2600:9000:2755:8400:1c:e59:4580:93a1, 2600:9000:2755:9a00:1c:e59:4580:93a1, 2600:9000:2755:fc00:1c:e59:4580:93a1
Response IP 108.156.133.98
Found Yes
Hash c3172e0a4e167f9b7293ca6917ed1f52102ccb1c4c921cc0aa8f149f6ce47e6d
SimHash 2850f94acb92

Groups

*

Rule Path
Disallow /direct/
Disallow /fblogin
Disallow /log/fpe

adsbot-google

Rule Path
Disallow /direct/
Disallow /log/fpe
Disallow /fblogin