raptorsupplies.co.uk
robots.txt
Robots Exclusion Standard data for raptorsupplies.co.uk
Resource Scan
Scan Details
Site Domain | raptorsupplies.co.uk |
Base Domain | raptorsupplies.co.uk |
Scan Status | Ok |
Last Scan | 2025-05-20T18:42:35+00:00 |
Next Scan | 2025-06-19T18:42:35+00:00 |
Last Scan
Scanned | 2025-05-20T18:42:35+00:00 |
URL | https://raptorsupplies.co.uk/robots.txt |
Domain IPs | 104.26.0.51, 104.26.1.51, 172.67.73.58, 2606:4700:20::681a:133, 2606:4700:20::681a:33, 2606:4700:20::ac43:493a |
Response IP | 104.26.0.51 |
Found | Yes |
Hash | e770ceb6a1dbfc774f51e5513544100ca84768f91991fdca65c4fafa0cde95c2 |
SimHash | c025d16cdcb1 |
Groups
*
Rule | Path |
---|---|
Allow | /p/ |
Allow | /pd/ |
Allow | /b/ |
Allow | /c/ |
Disallow | /*?acc_typ=rp_australia |
Disallow | /*?acc_typ=sgstralia |
Disallow | /*?acc_typ=rp_singapore |
Disallow | /*?acc_typ=sgstralia |
Disallow | /*?acc_typ=rp_australia* |
Disallow | /*?acc_typ=sgstralia* |
Disallow | /*?acc_typ=rp_singapore* |
Disallow | /*?acc_typ=sgstralia* |
Disallow | */checkout* |
Disallow | */default* |
Disallow | */pramp* |
Disallow | */customer/* |
Disallow | */customers/* |
Disallow | */app/* |
Disallow | */rest/* |
Disallow | */visitorsreport/* |
Disallow | */getprice* |
Disallow | */brand-pages/save_mcmaster_contact.php |
Disallow | */l3_ajax.php |
Disallow | */l3_ajax_apollo.php |
Disallow | */l3_m_ajax.php |
Disallow | */bd_req.php |
Disallow | */bd_ajax.php |
Disallow | */bd_mail.php |
Disallow | */brand_request_quote_send_mail.php |
Disallow | */ajax_check.php |
Disallow | */smr_request_quote_helper.php |
Disallow | */smr_request_quote.php |
Disallow | */smr_hp_api.php |
Disallow | */smr_credit_mail.php |
Disallow | */smr_api.php |
Disallow | */request_quote_send_mail.php |
Disallow | */save_add.php |
Disallow | */bd_api.php |
Disallow | */smrCallBackMailer.php |
Disallow | */getCartDetail.php |
Disallow | */create_order_paypal.php |
Disallow | */vpg_mp_ajax.php |
Disallow | */category_api.php |
Disallow | */category_l3_dynamic.php |
Disallow | */bd_nkm_ft_m_tw_test.php |
Disallow | */l2/add_to_cart.php |
Disallow | */l2/add_to_cart_plus.php |
Disallow | */l2/add_to_cart_minus.php |
Disallow | */l2_category_get_session.php |
Disallow | */l2_brand_sec.php |
Disallow | */display.php |
Disallow | */ipgeo/l3_page_ipgeo_api.php |
Disallow | */Action/getIp.php |
Disallow | */Action/getCountryList.php |
Disallow | */rpt/Helper/contact_us.php |
Disallow | */add_address.php |
Disallow | */edit_pi.php |
Disallow | */ipgeo/* |
Disallow | */pd/en-gb/* |
Disallow | */en-eu/* |
Disallow | */en/* |
Disallow | */pd/pd/* |
Disallow | */pd/p/* |
Disallow | */c/*/?* |
Disallow | */l1/*?* |
Disallow | */l1*?* |
Disallow | */vpg_api.php |
Disallow | */rpt/L3-El/includes/api/* |
Disallow | */rpt/VPG-Hybrid/includes/api/* |
Disallow | */rpt/* |
Disallow | */s?q* |
Disallow | */a2c/* |
Disallow | /*.php |
Disallow | /*?proId* |
Disallow | *?cat=* |
Disallow | */c/*/b/* |
Disallow | */request/* |
Disallow | */shop-atc/* |
Disallow | */atc/* |
Disallow | */wa/* |
Disallow | */catalogsearch/result?q=* |
Disallow | */utils/ |
Disallow | */zlib/ |
Disallow | */lib/ |
Disallow | */inftrees$ |
Disallow | */inffast$ |
Disallow | */trees$ |
Disallow | */common$ |
Disallow | */crc32$ |
Disallow | */adler32$ |
Disallow | */messages$ |
Disallow | */gzheader$ |
Disallow | */constants$ |
Disallow | */deflate$ |
Disallow | */zstream$ |
Disallow |
adsbot-google
Rule | Path |
---|---|
Allow | /p* |
Allow | /pd* |
Allow | /b* |
Allow | /c* |
Disallow | */checkout* |
Disallow | */default* |
Disallow | */pramp* |
Disallow | */customer/* |
Disallow | */customers/* |
Disallow | */app/* |
Disallow | */rest/* |
Disallow | */visitorsreport/* |
Disallow | */getprice* |
Disallow | */brand-pages/save_mcmaster_contact.php |
Disallow | */l3_ajax.php |
Disallow | */l3_ajax_apollo.php |
Disallow | */l3_m_ajax.php |
Disallow | */bd_ajax.php |
Disallow | */bd_req.php |
Disallow | */bd_mail.php |
Disallow | */brand_request_quote_send_mail.php |
Disallow | */ajax_check.php |
Disallow | */smr_request_quote_helper.php |
Disallow | */smr_request_quote.php |
Disallow | */smr_hp_api.php |
Disallow | */smr_credit_mail.php |
Disallow | */smr_api.php |
Disallow | */request_quote_send_mail.php |
Disallow | */en-eu/* |
Disallow | */en/* |
Disallow | */bd_api.php |
Disallow | */smrCallBackMailer.php |
Disallow | */getCartDetail.php |
Disallow | */create_order_paypal.php |
Disallow | */vpg_mp_ajax.php |
Disallow | */category_api.php |
Disallow | */category_l3_dynamic.php |
Disallow | */bd_nkm_ft_m_tw_test.php |
Disallow | */pd/pd/* |
Disallow | */pd/p/* |
Disallow | */vpg_api.php |
Disallow | */rpt/L3-El/includes/api/* |
Disallow | */rpt/VPG-Hybrid/includes/api/* |
Disallow | */rpt/* |
Disallow | */l2/add_to_cart.php |
Disallow | */l2/add_to_cart_plus.php |
Disallow | */l2/add_to_cart_minus.php |
Disallow | */l1/*?* |
Other Records
Field | Value |
---|---|
sitemap | https://www.raptorsupplies.co.uk/sitemaps/sitemap-index.xml |
sitemap | https://www.raptorsupplies.co.uk/sitemaps/sitemap-index-merge.xml |
sitemap | https://www.raptorsupplies.co.uk/sitemaps/sitemap-index-brand.xml |