woodcentral.com
robots.txt

Robots Exclusion Standard data for woodcentral.com

Resource Scan

Scan Details

Site Domain woodcentral.com
Base Domain woodcentral.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-05-04T21:12:22+00:00
Next Scan 2024-08-02T21:12:22+00:00

Last Successful Scan

Scanned2023-10-06T21:32:56+00:00
URL https://woodcentral.com/robots.txt
Redirect https://www.woodcentral.com/robots.txt
Redirect Domain www.woodcentral.com
Redirect Base woodcentral.com
Domain IPs 104.21.63.225, 172.67.172.90, 2606:4700:3030::6815:3fe1, 2606:4700:3035::ac43:ac5a
Redirect IPs 104.21.63.225, 172.67.172.90, 2606:4700:3030::6815:3fe1, 2606:4700:3035::ac43:ac5a
Response IP 104.21.63.225
Found Yes
Hash 458b492eedd72a4e281b6408e446d48d49df841cf47a30f22fa56342cb4b72f9
SimHash d0714c14d2c4

Groups

*

Rule Path
Disallow /2004/
Disallow /404/
Disallow /ADM/
Disallow /blab/
Disallow /cgi-bin/
Disallow /cms/
Disallow /htmlpurifier/
Disallow /mail/
Disallow /maillist/
Disallow /newforum/
Disallow /simplepie/
Disallow /store/
Disallow /scrapbook/
Disallow /wallpaper/
Disallow /webbbs/
Disallow /wiki/
Disallow /example.php
Disallow /extractor.php
Disallow /stopwords.txt
Disallow /forkbb/adm
Disallow /forkbb/log
Disallow /forkbb/mod
Disallow /forkbb/reg
Disallow /forkbb/search
Disallow /forkbb/post
Disallow /forkbb/forum/scroll
Disallow /forkbb/userlist/*/DESC/
Disallow /forkbb/userlist/*/ASC/
Disallow /marketplace/oc-admin/
Disallow /marketplace/oc-content/downloads/
Disallow /marketplace/oc-content/languages/
Disallow /marketplace/oc-content/uploads/HTML/
Disallow /marketplace/oc-content/uploads/minify/
Disallow /marketplace/oc-content/uploads/temp/
Disallow /marketplace/oc-includes/osclass/
Disallow /marketplace/oc-includes/vendor/

criteobot
linkdexbot
petalbot
ias-va
ias-oa
ias-ie
yandexbot
peer39_crawler
bytespider
bytedance
semrushbot
semrushbot/7
validator.nu
mj12bot
trendictionbot0.5.0
zoominfobot
nginx-ssl early hints
seekportbot
magpie-crawler
seznambot
seokicks
barkrowler/0.9
barkrowler

Rule Path
Disallow /