instantshift.com
robots.txt

Robots Exclusion Standard data for instantshift.com

Resource Scan

Scan Details

Site Domain instantshift.com
Base Domain instantshift.com
Scan Status Ok
Last Scan2025-11-29T17:04:01+00:00
Next Scan 2025-12-29T17:04:01+00:00

Last Scan

Scanned2025-11-29T17:04:01+00:00
URL https://instantshift.com/robots.txt
Domain IPs 104.21.46.220, 172.67.142.225, 2606:4700:3030::6815:2edc, 2606:4700:3033::ac43:8ee1
Response IP 104.21.46.220
Found Yes
Hash 36b35585553ed062f76c1388ebeb56205fb8b9202b0abf4c5e8c00a0c25a4419
SimHash de114c8887b3

Groups

*

Rule Path
Disallow /.svn
Disallow /clients/
Disallow /konami/
Disallow /wp-admin/

msiecrawler

Rule Path
Disallow /

psbot

Rule Path
Disallow /

fasterfox

Rule Path
Disallow /

xenu

Rule Path
Disallow /

sitesucker

Rule Path
Disallow /

Other Records

Field Value
sitemap http://www.instantshift.com/sitemap.xml
sitemap http://www.instantshift.com/sitemap.xml.gz