bwcommunity.eu
robots.txt
Robots Exclusion Standard data for bwcommunity.eu
Resource Scan
Scan Details
Site Domain | bwcommunity.eu |
Base Domain | bwcommunity.eu |
Scan Status | Ok |
Last Scan | 2024-09-30T07:04:36+00:00 |
Next Scan | 2024-10-30T07:04:36+00:00 |
Last Scan
Scanned | 2024-09-30T07:04:36+00:00 |
URL | https://bwcommunity.eu/robots.txt |
Domain IPs | 91.215.216.56 |
Response IP | 91.215.216.56 |
Found | Yes |
Hash | 63496aa339c111870544716ba922173fe8baa5b4c7455a06083a105ca8250dff |
SimHash | 927051a3ca88 |
Groups
baiduspider
baiduspider-video
baiduspider-image
mozilla/5.0 (compatible; baiduspider/2.0; +http://www.baidu.com/search/spider.html)
mozilla/5.0 (compatible; baiduspider/3.0; +http://www.baidu.com/search/spider.html)
mozilla/5.0 (compatible; baiduspider/4.0; +http://www.baidu.com/search/spider.html)
mozilla/5.0 (compatible; baiduspider/5.0; +http://www.baidu.com/search/spider.html)
baiduspider/2.0
baiduspider/3.0
baiduspider/4.0
baiduspider/5.0
Rule | Path |
---|---|
Disallow | / |
*
Rule | Path |
---|---|
Disallow | /startTopic/ |
Disallow | /*?do=add |
Disallow | /*?do=submit |
Disallow | /discover/unread/ |
Disallow | /markallread/ |
Disallow | /staff/ |
Disallow | /online/ |
Disallow | /discover/ |
Disallow | /leaderboard/ |
Disallow | /search/ |
Disallow | /*?advancedSearchForm= |
Disallow | /register/ |
Disallow | /lostpassword/ |
Disallow | /login/ |
Disallow | /*?sortby= |
Disallow | /*?filter= |
Disallow | /*?tab=comments |
Disallow | /*?do=email |
Disallow | /*?do=findComment |
Disallow | /*?do=getLastComment |
Disallow | /*?do=getNewComment |
Disallow | /profile/ |
Other Records
Field | Value |
---|---|
sitemap | https://www.bwcommunity.eu/sitemap.php |
Warnings
- 4 invalid lines.
Comments