bizdb.co.uk
robots.txt
Robots Exclusion Standard data for bizdb.co.uk
Resource Scan
Scan Details
| Site Domain | bizdb.co.uk |
| Base Domain | bizdb.co.uk |
| Scan Status | Ok |
| Last Scan | 2024-09-25T22:44:58+00:00 |
| Next Scan | 2024-10-02T22:44:58+00:00 |
Last Scan
| Scanned | 2024-09-25T22:44:58+00:00 |
| URL | https://bizdb.co.uk/robots.txt |
| Redirect | https://www.bizdb.co.uk/robots.txt |
| Redirect Domain | www.bizdb.co.uk |
| Redirect Base | bizdb.co.uk |
| Domain IPs | 149.202.250.17 |
| Redirect IPs | 149.202.250.17 |
| Response IP | 149.202.250.17 |
| Found | Yes |
| Hash | 7c083e526b7d495fc69bdd0f6392837cdd9aa941fc5ba75916d536b737a87490 |
| SimHash | e20815c35231 |
Groups
*
| Rule | Path |
|---|---|
| Allow | / |
*
| Rule | Path |
|---|---|
| Disallow | /add-siccodes/ |
| Disallow | /biaoqian |
| Disallow | /down |
| Disallow | /bplayer |
| Disallow | /xiaoshuoxiazai |
| Disallow | /archiver |
| Disallow | /wanjiatougao |
| Disallow | /gdsgzdt |
| Disallow | /danjiyouxi |
| Disallow | /news |
| Disallow | /blog |
| Disallow | /waigua |
| Disallow | /gbmgzdt |
| Disallow | /luokewangguogonglue |
| Disallow | /wangluoyouxifuzhu |
| Disallow | /chuanqi |
| Disallow | /cstupian |
| Disallow | /xiaoyouxi-gonglue |
| Disallow | /authent |
| Disallow | /danjiyouxi-gonglue |
| Disallow | /gamehot |
| Disallow | /index.php? |
| Disallow | /playhtml |
| Disallow | /qqchaoshigonglue |
| Disallow | /yingxionglianmengwaigua |
| Disallow | /zaomengxiyou3xiugaiqi |
| Disallow | /csol-gonglue |
| Disallow | /csxinde |
| Disallow | /goods |
| Disallow | /maoxiandaowaigua |
| Disallow | /qqyedianzhiwangfuzhu |
| Disallow | /rent/ |
| Disallow | /tag/ |
| Disallow | /vb/ |
| Disallow | /vodlist/ |
| Disallow | /030115/ |
| Disallow | /040115/ |
| Disallow | /admissions/ |
| Disallow | /aohitiandigonglue |
| Disallow | /article_t |
| Disallow | /artlist/ |
| Disallow | /buluoshouweizhangonglue |
| Disallow | /catalog/ |
| Disallow | /cgi-sys/ |
| Disallow | /chuanqi4 |
| Disallow | /comments/ |
| Disallow | /daitanshizhijianfuzhu/ |
| Disallow | /daxiachuanfuzhu/ |
| Disallow | /forum.php?%2F |
| Disallow | /forumdisplay.php/ |
| Disallow | /gongfupaifuzhu/ |
| Disallow | /hlsg/ |
| Disallow | /info/ |
| Disallow | /huanxiangshenyufuzhu/ |
| Disallow | /jijiaxuanfengfuzhu |
| Disallow | /library/ |
| Disallow | /lshf |
| Disallow | /megsanguo |
| Disallow | /notify-spped_bump?%2F |
| Disallow | /nvshenlianmengfuzhu/ |
| Disallow | /paopaokadingchewaigua |
| Disallow | /provider-solutions/ |
| Disallow | /ru/ |
| Disallow | /xiazai |
| Disallow | /yxwz/ |
| Disallow | /zhanhun/ |
| Disallow | /zhenwangfuzhu |
| Disallow | /zuixiyoufuzhu |
| Disallow | /youlingxingdont4gonglue |
| Disallow | /*item$ |
| Disallow | /job-offer/ |
| Disallow | /job-offers-query/ |
| Disallow | /staff-query/ |
| Disallow | /filter-sic/ |
| Disallow | /filter-post/ |
| Disallow | /filter-town/ |
| Disallow | /filter-listing/ |
| Disallow | /filing/show/ |
| Disallow | /psc-details/ |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.bizdb.co.uk/sitemap.xml |