allenandunwin.com
robots.txt

Robots Exclusion Standard data for allenandunwin.com

Resource Scan

Scan Details

Site Domain allenandunwin.com
Base Domain allenandunwin.com
Scan Status Ok
Last Scan2024-09-17T02:24:16+00:00
Next Scan 2024-10-17T02:24:16+00:00

Last Scan

Scanned2024-09-17T02:24:16+00:00
URL https://allenandunwin.com/robots.txt
Redirect https://www.allenandunwin.com/robots.txt
Redirect Domain www.allenandunwin.com
Redirect Base allenandunwin.com
Domain IPs 108.156.133.126, 108.156.133.40, 108.156.133.79, 108.156.133.80, 2600:9000:2755:200:d:3ccd:3a40:93a1, 2600:9000:2755:2600:d:3ccd:3a40:93a1, 2600:9000:2755:6400:d:3ccd:3a40:93a1, 2600:9000:2755:9c00:d:3ccd:3a40:93a1, 2600:9000:2755:9e00:d:3ccd:3a40:93a1, 2600:9000:2755:b800:d:3ccd:3a40:93a1, 2600:9000:2755:c00:d:3ccd:3a40:93a1, 2600:9000:2755:fe00:d:3ccd:3a40:93a1
Redirect IPs 108.156.133.126, 108.156.133.40, 108.156.133.79, 108.156.133.80, 2600:9000:2755:2200:d:3ccd:3a40:93a1, 2600:9000:2755:4e00:d:3ccd:3a40:93a1, 2600:9000:2755:8600:d:3ccd:3a40:93a1, 2600:9000:2755:9800:d:3ccd:3a40:93a1, 2600:9000:2755:b200:d:3ccd:3a40:93a1, 2600:9000:2755:c200:d:3ccd:3a40:93a1, 2600:9000:2755:dc00:d:3ccd:3a40:93a1, 2600:9000:2755:f400:d:3ccd:3a40:93a1
Response IP 108.156.133.80
Found Yes
Hash 30cba6dc758ce2f42efbbb7a8c64611c4765aad2c1ac9334919bb5fb987f4c2d
SimHash 69154c16cfd3

Groups

*

Rule Path
Disallow /admin/
Disallow /cart/
Disallow /client/

Other Records

Field Value
sitemap http://www.allenandunwin.com/sitemap.xml