swgr.org
robots.txt

Robots Exclusion Standard data for swgr.org

Resource Scan

Scan Details

Site Domain swgr.org
Base Domain swgr.org
Scan Status Ok
Last Scan2024-11-07T09:42:21+00:00
Next Scan 2024-12-07T09:42:21+00:00

Last Scan

Scanned2024-11-07T09:42:21+00:00
URL https://swgr.org/robots.txt
Domain IPs 18.155.68.119, 18.155.68.34, 18.155.68.39, 18.155.68.47, 2600:9000:2816:3200:1b:7c1a:7040:93a1, 2600:9000:2816:3400:1b:7c1a:7040:93a1, 2600:9000:2816:3600:1b:7c1a:7040:93a1, 2600:9000:2816:a200:1b:7c1a:7040:93a1, 2600:9000:2816:a600:1b:7c1a:7040:93a1, 2600:9000:2816:ac00:1b:7c1a:7040:93a1, 2600:9000:2816:b200:1b:7c1a:7040:93a1, 2600:9000:2816:fe00:1b:7c1a:7040:93a1
Response IP 18.155.68.47
Found Yes
Hash d8083a697f9a507268777dc55cd9a8a573c12c587b596c0b4e566a6b81e333de
SimHash 206d40c7de01

Groups

petalbot
aspiegelbot
ahrefsbot
semrushbot
semrush
dotbot
mauibot
mj12bot

Rule Path
Disallow /

amazonbot

Rule Path
Disallow /threads/*/reply

*

Rule Path
Disallow /account/
Disallow /members/
Disallow /attachments/
Disallow /goto/
Disallow /login/
Disallow /admin.php
Disallow /kreetle
Disallow /dianoga
Disallow /skill-calc
Disallow /staging
Disallow /internal_data
Disallow /data
Disallow /install
Disallow /util

Other Records

Field Value
sitemap https://swgr.org/sitemap.xml

Comments

  • xenforo disallows
  • disallow internal directories