gunbuyer.com
robots.txt
Robots Exclusion Standard data for gunbuyer.com
Resource Scan
Scan Details
| Site Domain | gunbuyer.com |
| Base Domain | gunbuyer.com |
| Scan Status | Ok |
| Last Scan | 2024-05-29T03:05:44+00:00 |
| Next Scan | 2024-06-28T03:05:44+00:00 |
Last Scan
| Scanned | 2024-05-29T03:05:44+00:00 |
| URL | https://gunbuyer.com/robots.txt |
| Redirect | https://www.gunbuyer.com/robots.txt |
| Redirect Domain | www.gunbuyer.com |
| Redirect Base | gunbuyer.com |
| Domain IPs | 172.66.40.96, 172.66.43.160, 2606:4700:3108::ac42:2860, 2606:4700:3108::ac42:2ba0 |
| Redirect IPs | 172.66.40.96, 172.66.43.160, 2606:4700:3108::ac42:2860, 2606:4700:3108::ac42:2ba0 |
| Response IP | 172.66.43.160 |
| Found | Yes |
| Hash | ba893731ae06d045ff82acd76f60f1e48dec86d631b3e7e0ec4fad96fda89b6f |
| SimHash | ad34625e20b2 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /index.php/ |
| Disallow | /*? |
| Disallow | /checkout/ |
| Disallow | /app/ |
| Disallow | /lib/ |
| Disallow | /*.php$ |
| Disallow | /pkginfo/ |
| Disallow | /report/ |
| Disallow | /var/ |
| Disallow | /catalog/ |
| Disallow | /customer/ |
| Disallow | /sendfriend/ |
| Disallow | /review/ |
| Disallow | /*SID%3D |
yandex
ichiro
moget
naverbot
baiduspider
baidu
sogou
youdao
mj12bot
goodzer
istellabot
gigabot
dotbot
seznambot
ltx71
spiderbot
opensiteexplorer
openlinkprofiler
majestic12
datagnion
sogou
ahrefs
scoutjet
changedetection
istellabot
napovedaseznam
linkfluence
smarter
mj12bot
mojeek
naver
deusu
slack
aihitdata
wotbox
kazbt
mediatoolkit
safedns
aboundex
webmeup-crawler
orangebot
| Rule | Path |
|---|---|
| Disallow | / |
*
| Rule | Path |
|---|---|
| Disallow | /app/ |
| Disallow | /bin/ |
| Disallow | /dev/ |
| Disallow | /lib/ |
| Disallow | /phpserver/ |
| Disallow | /setup/ |
| Disallow | /update/ |
| Disallow | /var/ |
| Disallow | /vendor/ |
| Disallow | /composer.json |
| Disallow | /composer.lock |
| Disallow | /CONTRIBUTING.md |
| Disallow | /CONTRIBUTOR_LICENSE_AGREEMENT.html |
| Disallow | /COPYING.txt |
| Disallow | /Gruntfile.js |
| Disallow | /LICENSE.txt |
| Disallow | /LICENSE_AFL.txt |
| Disallow | /nginx.conf.sample |
| Disallow | /package.json |
| Disallow | /php.ini.sample |
| Disallow | /RELEASE_NOTES.txt |
| Disallow | /*?*product_list_mode= |
| Disallow | /*?*product_list_order= |
| Disallow | /*?*product_list_limit= |
| Disallow | /*?*product_list_dir= |
| Disallow | /*.php$ |
| Disallow | /*?SID= |
| Disallow | /*.CVS |
| Disallow | /*.Zip$ |
| Disallow | /*.Svn$ |
| Disallow | /*.Idea$ |
| Disallow | /*.Sql$ |
| Disallow | /*.Tgz$ |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.gunbuyer.com/sitemap.xml |
Warnings
- `https` is not a known field.
Comments