airgunwarriors.com
robots.txt

Robots Exclusion Standard data for airgunwarriors.com

Resource Scan

Scan Details

Site Domain airgunwarriors.com
Base Domain airgunwarriors.com
Scan Status Failed
Failure ReasonScan timed out.
Last Scan2024-10-07T09:20:34+00:00
Next Scan 2025-01-05T09:20:34+00:00

Last Successful Scan

Scanned2023-08-18T02:09:50+00:00
URL https://airgunwarriors.com/robots.txt
Domain IPs 162.211.80.228
Response IP 162.211.80.228
Found Yes
Hash 4fe725ecd074896e6ba42d5198de0f82dd3d5488c9428b13dbcd51eebdcfa4f1
SimHash d26e4198ea0a

Groups

baiduspider
yisouspider
petalbot

Rule Path
Disallow /

bytespider

Rule Path
Disallow /

sogou web spider

Rule Path
Disallow /

sogou inst spider

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

clickagy

Rule Path
Disallow /

proximic

Rule Path
Disallow /

ahref

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

seznambot

Rule Path
Disallow /

admantx

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

adsbot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

mojeekbot

Rule Path
Disallow /

*

Rule Path
Disallow /community/classifieds-boneyard/
Disallow /community/board-of-inquiry/
Disallow /community/off-topic/
Disallow /community/the-fifth-shot/
Disallow /community/shooting-the-breeze/
Disallow /community/forum-matters-help-center/
Disallow /community/the-boardroom/
Disallow /community/the-dmz/
Disallow /participants/
Disallow /participant/
Disallow /profile/
Disallow /members/
Disallow /Login/
Disallow /community/?foro=signin&redirect_to=https%3A%2F%2Fairgunwarriors.com%2F%2F
Disallow /community/?foro=signup&redirect_to=https%3A%2F%2Fairgunwarriors.com%2F%2F
Disallow /register/?
Disallow /community/recent/
Disallow /cgi-bin/
Disallow /zbblock/
Disallow /zbbtroubleticket/
Disallow /cache_control/
Disallow /wp-admin/
Disallow /wp-includes/

Warnings

  • 1 invalid line.