dawgscentral.com
robots.txt

Robots Exclusion Standard data for dawgscentral.com

Resource Scan

Scan Details

Site Domain dawgscentral.com
Base Domain dawgscentral.com
Scan Status Ok
Last Scan2024-09-26T01:11:45+00:00
Next Scan 2024-10-03T01:11:45+00:00

Last Scan

Scanned2024-09-26T01:11:45+00:00
URL https://dawgscentral.com/robots.txt
Redirect https://www.dawgscentral.com/robots.txt
Redirect Domain www.dawgscentral.com
Redirect Base dawgscentral.com
Domain IPs 2600:9000:2024:2400:c:d652:9c00:93a1, 2600:9000:2024:3e00:c:d652:9c00:93a1, 2600:9000:2024:4800:c:d652:9c00:93a1, 2600:9000:2024:5e00:c:d652:9c00:93a1, 2600:9000:2024:6600:c:d652:9c00:93a1, 2600:9000:2024:da00:c:d652:9c00:93a1, 2600:9000:2024:e200:c:d652:9c00:93a1, 2600:9000:2024:fc00:c:d652:9c00:93a1, 65.9.112.114, 65.9.112.13, 65.9.112.63, 65.9.112.90
Redirect IPs 2600:9000:269b:5000:c:d652:9c00:93a1, 2600:9000:269b:6000:c:d652:9c00:93a1, 2600:9000:269b:6400:c:d652:9c00:93a1, 2600:9000:269b:800:c:d652:9c00:93a1, 2600:9000:269b:a00:c:d652:9c00:93a1, 2600:9000:269b:bc00:c:d652:9c00:93a1, 2600:9000:269b:e000:c:d652:9c00:93a1, 2600:9000:269b:f800:c:d652:9c00:93a1, 3.160.196.110, 3.160.196.17, 3.160.196.24, 3.160.196.54
Response IP 3.164.206.61
Found Yes
Hash 3d6de71f32068de5aee00f412d89af80f5be32e448d07d001705d3a4666ae6b6
SimHash 30706a01849a

Groups

*

Rule Path
Disallow /startTopic/
Disallow /discover/unread/
Disallow /markallread/
Disallow /staff/
Disallow /cookie/
Disallow /online/
Disallow /discover/
Disallow /leaderboard/
Disallow /search/
Disallow /tags/
Disallow /*?advancedSearchForm=
Disallow /register/
Disallow /lostpassword/
Disallow /login/
Disallow /*?sortby=
Disallow /*?filter=
Disallow /*?tab=
Disallow /*?do=
Disallow /*ref%3D
Disallow /*?forumId*
Disallow /*?&controller=embed

Other Records

Field Value
sitemap https://www.dawgscentral.com/sitemap.php

Comments

  • Rules for Invision Community (https://invisioncommunity.com)
  • Block pages with no unique content
  • Block faceted pages and 301 redirect pages
  • Sitemap URL