wvtailgatecentral.com
robots.txt

Robots Exclusion Standard data for wvtailgatecentral.com

Resource Scan

Scan Details

Site Domain wvtailgatecentral.com
Base Domain wvtailgatecentral.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-11-18T13:53:29+00:00
Next Scan 2025-12-02T13:53:29+00:00

Last Successful Scan

Scanned2025-11-02T14:46:42+00:00
URL https://wvtailgatecentral.com/robots.txt
Domain IPs 66.96.149.17
Response IP 66.96.149.17
Found Yes
Hash afc07821f592b8a978ad326c907610316944bdc9434114a37f229e859b0cbb5b
SimHash 750dd640cec1

Groups

*

Rule Path
Disallow
Disallow /cgi-bin/
Disallow /forum_tgc/
Disallow /forum_tgc/index.php?action=printpage*
Disallow /forum_tgc/index.php?action=profile*
Disallow /forum_tgc/index.php?action=search
Disallow /*%26print%3D1
Disallow /hs/bb2020/
Disallow /hs/fb2019/
Disallow /hs/bb2019/
Disallow /hs/fb2018/
Disallow /hs/bb2018/
Disallow /hs/fb2017/
Disallow /hs/bb2017/
Disallow /hs/fb2016/
Disallow /hs/bb2016/
Disallow /hs/fb2015/
Disallow /hs/bb2015/
Disallow /hs/fb2013/
Disallow /hs/bb2014/
Disallow /hs/fb2014/
Disallow /hs/fb2013/
Disallow /hs/fb2012/
Disallow /hs/bb2012/
Disallow /hs/fb2011/
Disallow /hs/fb2011/
Disallow /hs/fb2010/
Disallow /hs/bb2010/

Other Records

Field Value
crawl-delay 60

Comments

  • robots.txt generated at http://www.mcanerin.com