floridagunexchange.com
robots.txt

Robots Exclusion Standard data for floridagunexchange.com

Resource Scan

Scan Details

Site Domain floridagunexchange.com
Base Domain floridagunexchange.com
Scan Status Ok
Last Scan2024-09-07T21:01:35+00:00
Next Scan 2024-10-07T21:01:35+00:00

Last Scan

Scanned2024-09-07T21:01:35+00:00
URL https://floridagunexchange.com/robots.txt
Redirect https://www.floridagunexchange.com/robots.txt
Redirect Domain www.floridagunexchange.com
Redirect Base floridagunexchange.com
Domain IPs 104.26.8.220, 104.26.9.220, 172.67.73.154, 2606:4700:20::681a:8dc, 2606:4700:20::681a:9dc, 2606:4700:20::ac43:499a
Redirect IPs 104.26.8.220, 104.26.9.220, 172.67.73.154, 2606:4700:20::681a:8dc, 2606:4700:20::681a:9dc, 2606:4700:20::ac43:499a
Response IP 104.26.9.220
Found Yes
Hash c19a5ac1abf27ffdd183411f4f67c99d95346e330a5e7639a2071fdf30ade40f
SimHash ad364a0d2092

Groups

yandex
ichiro
moget
naverbot
baiduspider
baidu
sogou
youdao
mj12bot
goodzer
istellabot
gigabot
dotbot
seznambot
ltx71
spiderbot
opensiteexplorer
openlinkprofiler
majestic12
datagnion
sogou
ahrefs
scoutjet
changedetection
istellabot
napovedaseznam
linkfluence
smarter
mj12bot
mojeek
naver
deusu
slack
aihitdata
wotbox
kazbt
mediatoolkit
safedns
aboundex
webmeup-crawler
orangebot

Rule Path
Disallow /

googlebot-image

Rule Path
Disallow

*

Rule Path
Disallow /index.php/
Disallow /*?
Disallow /checkout/
Disallow /app/
Disallow /lib/
Disallow /*.php$
Disallow /pkginfo/
Disallow /report/
Disallow /var/
Disallow /catalog/
Disallow /customer/
Disallow /sendfriend/
Disallow /review/
Disallow /*SID%3D

Comments

  • Google Image Crawler Setup
  • Crawlers Setup