Log In Sign Up

allenandunwin.com
robots.txt

Robots Exclusion Standard data for allenandunwin.com

Resource Scan

Scan Details

Site Domain allenandunwin.com
Base Domain allenandunwin.com
Scan Status Ok
Last Scan2024-11-16T02:50:34+00:00
Next Scan 2024-12-16T02:50:34+00:00

Last Scan

Scanned2024-11-16T02:50:34+00:00
URL https://allenandunwin.com/robots.txt
Redirect https://www.allenandunwin.com/robots.txt
Redirect Domain www.allenandunwin.com
Redirect Base allenandunwin.com
Domain IPs 108.156.133.126, 108.156.133.40, 108.156.133.79, 108.156.133.80, 2600:9000:2755:0:d:3ccd:3a40:93a1, 2600:9000:2755:5000:d:3ccd:3a40:93a1, 2600:9000:2755:5a00:d:3ccd:3a40:93a1, 2600:9000:2755:7000:d:3ccd:3a40:93a1, 2600:9000:2755:8e00:d:3ccd:3a40:93a1, 2600:9000:2755:9600:d:3ccd:3a40:93a1, 2600:9000:2755:d000:d:3ccd:3a40:93a1, 2600:9000:2755:d400:d:3ccd:3a40:93a1
Redirect IPs 108.156.133.126, 108.156.133.40, 108.156.133.79, 108.156.133.80, 2600:9000:2755:3000:d:3ccd:3a40:93a1, 2600:9000:2755:3600:d:3ccd:3a40:93a1, 2600:9000:2755:4600:d:3ccd:3a40:93a1, 2600:9000:2755:4c00:d:3ccd:3a40:93a1, 2600:9000:2755:8400:d:3ccd:3a40:93a1, 2600:9000:2755:b400:d:3ccd:3a40:93a1, 2600:9000:2755:d000:d:3ccd:3a40:93a1, 2600:9000:2755:fc00:d:3ccd:3a40:93a1
Response IP 108.156.133.80
Found Yes
Hash 30cba6dc758ce2f42efbbb7a8c64611c4765aad2c1ac9334919bb5fb987f4c2d
SimHash 69154c16cfd3

Groups

*

Rule Path
Disallow /admin/
Disallow /cart/
Disallow /client/
Back to top

Other Records

Field Value
sitemap http://www.allenandunwin.com/sitemap.xml
Back to top