mychicagosteak.com
robots.txt
Robots Exclusion Standard data for mychicagosteak.com
Resource Scan
Scan Details
| Site Domain | mychicagosteak.com |
| Base Domain | mychicagosteak.com |
| Scan Status | Ok |
| Last Scan | 2024-06-15T14:49:31+00:00 |
| Next Scan | 2024-06-22T14:49:31+00:00 |
Last Scan
| Scanned | 2024-06-15T14:49:31+00:00 |
| URL | https://mychicagosteak.com/robots.txt |
| Redirect | https://www.mychicagosteak.com/robots.txt |
| Redirect Domain | www.mychicagosteak.com |
| Redirect Base | mychicagosteak.com |
| Domain IPs | 104.26.2.170, 104.26.3.170, 172.67.73.56, 2606:4700:20::681a:2aa, 2606:4700:20::681a:3aa, 2606:4700:20::ac43:4938 |
| Redirect IPs | 104.26.2.170, 104.26.3.170, 172.67.73.56, 2606:4700:20::681a:2aa, 2606:4700:20::681a:3aa, 2606:4700:20::ac43:4938 |
| Response IP | 104.26.3.170 |
| Found | Yes |
| Hash | e24f3ced1bec6a40e222f0cd9b1f533b86851510c8af09ba21ee7b2186b11bba |
| SimHash | ad354a24a892 |
Groups
yandex
ichiro
moget
naverbot
baiduspider
baidu
sogou
youdao
mj12bot
goodzer
istellabot
gigabot
dotbot
seznambot
ltx71
spiderbot
opensiteexplorer
openlinkprofiler
majestic12
datagnion
sogou
ahrefs
scoutjet
changedetection
istellabot
napoveda.seznam
linkfluence
smarter
mj12bot
mojeek
naver
deusu
slack
aihitdata
wotbox
kazbt
mediatoolkit
safedns
aboundex
webmeup-crawler
orangebot
baiduspider-video
baiduspider-image
| Rule | Path |
|---|---|
| Disallow | / |
*
| Rule | Path |
|---|---|
| Disallow | /catalog/product/gallery/ |
| Disallow | /add-on-* |
*
| Rule | Path |
|---|---|
| Disallow | /prime_steak08 |
*
| Rule | Path |
|---|---|
| Disallow | /offers |
*
| Rule | Path |
|---|---|
| Disallow | /exclusive-limited-time-offer |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.mychicagosteak.com/steak-university/sitemap_index.xml |
| sitemap | https://www.mychicagosteak.com/media/sitemap_steak.xml |