ar15.com
robots.txt

Robots Exclusion Standard data for ar15.com

Resource Scan

Scan Details

Site Domain ar15.com
Base Domain ar15.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-11-07T22:11:52+00:00
Next Scan 2025-02-05T22:11:52+00:00

Last Successful Scan

Scanned2024-04-12T21:57:06+00:00
URL https://ar15.com/robots.txt
Domain IPs 104.22.30.91, 104.22.31.91, 172.67.7.186, 2606:4700:10::6816:1e5b, 2606:4700:10::6816:1f5b, 2606:4700:10::ac43:7ba
Response IP 104.22.31.91
Found Yes
Hash 4d9fcff47ae6a89a32837772608493db0ebb950b181c6ef412e24f46a5fea4c0
SimHash fb037944e6f0

Groups

*

Rule Path
Disallow /admin/
Disallow /ammo/
Disallow /archive/
Disallow /biz/
Disallow /blogs/
Disallow /content/
Disallow /core/
Disallow /gear-locker/
Disallow /gunstruction/
Disallow /images/
Disallow /media/
Disallow /member/
Disallow /weaponlibrary/

Other Records

Field Value
sitemap https://www.ar15.com/sitemap/sitemap.xml

Comments

  • ------------------------------------------------------------------------
  • Updated Last 08/2017
  • ------------------------------------------------------------------------

Warnings

  • `visit-time` is not a known field.