gunstar.co.uk
robots.txt
Robots Exclusion Standard data for gunstar.co.uk
Resource Scan
Scan Details
Site Domain | gunstar.co.uk |
Base Domain | gunstar.co.uk |
Scan Status | Failed |
Failure Stage | Fetching resource. |
Failure Reason | Server returned a client error. |
Last Scan | 2024-10-24T14:12:14+00:00 |
Next Scan | 2024-11-23T14:12:14+00:00 |
Last Successful Scan
Scanned | 2024-09-25T14:11:03+00:00 |
URL | https://gunstar.co.uk/robots.txt |
Redirect | https://www.gunstar.co.uk/robots.txt |
Redirect Domain | www.gunstar.co.uk |
Redirect Base | gunstar.co.uk |
Domain IPs | 104.26.12.93, 104.26.13.93, 172.67.73.243, 2606:4700:20::681a:c5d, 2606:4700:20::681a:d5d, 2606:4700:20::ac43:49f3 |
Redirect IPs | 104.26.12.93, 104.26.13.93, 172.67.73.243, 2606:4700:20::681a:c5d, 2606:4700:20::681a:d5d, 2606:4700:20::ac43:49f3 |
Response IP | 172.67.73.243 |
Found | Yes |
Hash | 7e3cc32b3743fed44683a9b8227484488dd009fbc6d6efcb6fd21361abc286af |
SimHash | 512e987e3ae8 |
Groups
*
No rules defined. All paths allowed.
Other Records
Field | Value |
---|---|
crawl-delay | 5 |
mediapartners-google
Rule | Path |
---|---|
Disallow | /*?sstr=* |
Disallow | /*?ads_pa=* |
Disallow | /print_ad.php |
Disallow | /ads_print.php |
Disallow | /print_ad_payment.php |
Disallow | /print_voucher.php |
Disallow | /print_terms.php |
Disallow | /*email_stats_id%3D* |
Disallow | /*?pn=* |
Disallow | /*?ads_gs* |
Disallow | /*?amp* |
Disallow | /*fbclid%3D* |
Disallow | /*ads_sca* |
Disallow | /*cert%3D* |
Disallow | /*op%3D* |
Disallow | /members.php* |
Disallow | /member/* |
Disallow | /member.php* |
Disallow | /*ads_i%3D* |
Disallow | /*ads_v%3D* |
Disallow | /*ads_pid%3D* |
Disallow | /*list_type%3D* |
Disallow | /*ads_tp%3D* |
Disallow | /*ads_y%3D* |
Disallow | /*cmonth%3D* |
Disallow | /*cyear%3D* |
Disallow | /*view_mode%3D* |
Disallow | /*order_advice%3D* |
Disallow | /*ads_maid%3D* |
Disallow | /*ads_c%3D* |
Disallow | /*ads_ctid%3D* |
Disallow | /*url%3Dmaxdim* |
Disallow | /*ads_nw%3D* |
Disallow | /*cat_id%3D* |
Disallow | /*sec_id%3D* |
Disallow | /*ads_berth%3D* |
Disallow | /*order%3D* |
Disallow | /*qf_cat%3D* |
Disallow | /*accfnw%3D* |
Disallow | /*accfrl%3D* |
Disallow | /*accfpp%3D* |
Disallow | /*radius%3D* |
Disallow | /*_test_email_lang* |
Disallow | */ADP/* |
Disallow | */CFI/* |
Disallow | */IJK/* |
Disallow | */AFJ/* |
Disallow | */ACD/* |
Disallow | */AEF/* |
Disallow | */ABP/* |
Disallow | */CDI/* |
Disallow | */AIN/* |
Disallow | */AFL/* |
Disallow | */CIL/* |
Disallow | */IJN/* |
Disallow | */AFG/* |
Disallow | */AIK/* |
Disallow | */BFI/* |
Disallow | */CGM/* |
Disallow | */ACP/* |
Disallow | */AJO/* |
Disallow | */HIJ/* |
Disallow | */AHJ/* |
Disallow | */AEI/* |
Disallow | */AFK/* |
Disallow | */ABG/* |
Disallow | */ABF/* |
Disallow | */ACG/* |
Disallow | */ADK/* |
Disallow | */BDF/* |
Disallow | */AIM/* |
Disallow | */AEG/* |
Disallow | */ADE/* |
Disallow | */DJP/* |
Disallow | */CIK/* |
Disallow | */CGI/* |
Disallow | */DFJ/* |
Disallow | */BIP/* |
Disallow | */ADN/* |
Disallow | */FIK/* |
Disallow | */CIP/* |
Disallow | */ACF/* |
Disallow | */DFP/* |
Disallow | */DEF/* |
Disallow | */IJL/* |
Disallow | */FJN/* |
Disallow | */BDI/* |
Disallow | */AFP/* |
Disallow | */IJO/* |
Disallow | */FJP/* |
Disallow | */ADL/* |
Disallow | */EIJ/* |
Disallow | */AFH/* |
Disallow | */BIL/* |
Disallow | */AGH/* |
Disallow | */ACN/* |
Disallow | */BIO/* |
Disallow | */ADO/* |
Disallow | */ADM/* |
Disallow | */ABE/* |
Disallow | */DEJ/* |
Disallow | */AGK/* |
Disallow | */ACK/* |
Disallow | */IJM/* |
Disallow | */DIP/* |
Disallow | */DFM/* |
Disallow | */AHP/* |
Disallow | */AFN/* |
Disallow | */BIK/* |
Disallow | */BGI/* |
Disallow | */AHN/* |
Disallow | */DFG/* |
Disallow | */CIO/* |
Disallow | */CDF/* |
Disallow | */AJL/* |
Disallow | */AGP/* |
Disallow | */AFO/* |
Disallow | */AEH/* |
Disallow | */ACO/* |
Disallow | */ABN/* |
Disallow | */INP/* |
Disallow | */FGJ/* |
Disallow | */DJK/* |
Disallow | */CKP/* |
Disallow | */CFK/* |
Disallow | */ADS/* |
Disallow | */EJP/* |
Disallow | */CEI/* |
Disallow | */AOP/* |
Disallow | */ANP/* |
Disallow | */AGN/* |
Disallow | */AGM/* |
Disallow | */AFM/* |
Disallow | */AEP/* |
Disallow | */ABH/* |
Disallow | */IMS/* |
Disallow | */GJN/* |
Disallow | */FKP/* |
Disallow | */FJK/* |
Disallow | */DJN/* |
Disallow | */DFN/* |
Disallow | */CIN/* |
Disallow | */CIM/* |
Disallow | */CHI/* |
Disallow | */CDP/* |
Disallow | */BDP/* |
Disallow | */AJM/* |
Disallow | */AGL/* |
Disallow | */AEN/* |
Disallow | */ACL/* |
Disallow | */ACH/* |
Disallow | */ABK/* |
Disallow | */FJO/* |
Disallow | */FHJ/* |
Disallow | */EFJ/* |
Disallow | */DHJ/* |
Disallow | */DGI/* |
Disallow | */DFS/* |
Disallow | */DFH/* |
Disallow | */CFG/* |
Disallow | */BFP/* |
Disallow | */BFO/* |
Disallow | */BEI/* |
Disallow | */BDN/* |
Disallow | */BDG/* |
Disallow | */AIS/* |
Disallow | */AEL/* |
Disallow | */ACE/* |
Disallow | */RPD/* |
Disallow | */KLP/* |
Disallow | */IKL/* |
Disallow | */HJP/* |
Disallow | */HJK/* |
Disallow | */GMP/* |
Disallow | */GJK/* |
Disallow | */GIK/* |
Disallow | */GHI/* |
Disallow | */FLP/* |
Disallow | */FIP/* |
Disallow | */FIO/* |
Disallow | */FIN/* |
Disallow | */EKO/* |
Disallow | */EIK/* |
Disallow | */EGJ/* |
Disallow | */EFH/* |
Disallow | */DMS/* |
Disallow | */DMP/* |
Disallow | */DKN/* |
Disallow | */DJO/* |
Disallow | */DJL/* |
Disallow | */DIS/* |
Disallow | */DIN/* |
Disallow | */DHM/* |
Disallow | */DGO/* |
Disallow | */DEI/* |
Disallow | */CHK/* |
Disallow | */CGK/* |
Disallow | */CGH/* |
Disallow | */CEP/* |
Disallow | */CEF/* |
Disallow | */BNP/* |
Disallow | */BIS/* |
Disallow | */BGP/* |
Disallow | */BFH/* |
Disallow | */BEO/* |
Disallow | */BDK/* |
Disallow | */BDH/* |
Disallow | */BDE/* |
Disallow | */ANO/* |
Disallow | */AMP/* |
Disallow | */ALO/* |
Disallow | */AKN/* |
Disallow | */AKL/* |
Disallow | */AHM/* |
Disallow | */AGS/* |
Disallow | */AEO/* |
Disallow | */ABM/* |
Disallow | */ABL/* |
Disallow | /*ads_pid_min%3D* |
Disallow | /help.php |
Other Records
Field | Value |
---|---|
sitemap | https://www.gunstar.co.uk/map/sitemap_index.xml |