raptorsupplies.co.uk
robots.txt

Robots Exclusion Standard data for raptorsupplies.co.uk

Resource Scan

Scan Details

Site Domain raptorsupplies.co.uk
Base Domain raptorsupplies.co.uk
Scan Status Ok
Last Scan2025-05-20T18:42:35+00:00
Next Scan 2025-06-19T18:42:35+00:00

Last Scan

Scanned2025-05-20T18:42:35+00:00
URL https://raptorsupplies.co.uk/robots.txt
Domain IPs 104.26.0.51, 104.26.1.51, 172.67.73.58, 2606:4700:20::681a:133, 2606:4700:20::681a:33, 2606:4700:20::ac43:493a
Response IP 104.26.0.51
Found Yes
Hash e770ceb6a1dbfc774f51e5513544100ca84768f91991fdca65c4fafa0cde95c2
SimHash c025d16cdcb1

Groups

*

Rule Path
Allow /p/
Allow /pd/
Allow /b/
Allow /c/
Disallow /*?acc_typ=rp_australia
Disallow /*?acc_typ=sgstralia
Disallow /*?acc_typ=rp_singapore
Disallow /*?acc_typ=sgstralia
Disallow /*?acc_typ=rp_australia*
Disallow /*?acc_typ=sgstralia*
Disallow /*?acc_typ=rp_singapore*
Disallow /*?acc_typ=sgstralia*
Disallow */checkout*
Disallow */default*
Disallow */pramp*
Disallow */customer/*
Disallow */customers/*
Disallow */app/*
Disallow */rest/*
Disallow */visitorsreport/*
Disallow */getprice*
Disallow */brand-pages/save_mcmaster_contact.php
Disallow */l3_ajax.php
Disallow */l3_ajax_apollo.php
Disallow */l3_m_ajax.php
Disallow */bd_req.php
Disallow */bd_ajax.php
Disallow */bd_mail.php
Disallow */brand_request_quote_send_mail.php
Disallow */ajax_check.php
Disallow */smr_request_quote_helper.php
Disallow */smr_request_quote.php
Disallow */smr_hp_api.php
Disallow */smr_credit_mail.php
Disallow */smr_api.php
Disallow */request_quote_send_mail.php
Disallow */save_add.php
Disallow */bd_api.php
Disallow */smrCallBackMailer.php
Disallow */getCartDetail.php
Disallow */create_order_paypal.php
Disallow */vpg_mp_ajax.php
Disallow */category_api.php
Disallow */category_l3_dynamic.php
Disallow */bd_nkm_ft_m_tw_test.php
Disallow */l2/add_to_cart.php
Disallow */l2/add_to_cart_plus.php
Disallow */l2/add_to_cart_minus.php
Disallow */l2_category_get_session.php
Disallow */l2_brand_sec.php
Disallow */display.php
Disallow */ipgeo/l3_page_ipgeo_api.php
Disallow */Action/getIp.php
Disallow */Action/getCountryList.php
Disallow */rpt/Helper/contact_us.php
Disallow */add_address.php
Disallow */edit_pi.php
Disallow */ipgeo/*
Disallow */pd/en-gb/*
Disallow */en-eu/*
Disallow */en/*
Disallow */pd/pd/*
Disallow */pd/p/*
Disallow */c/*/?*
Disallow */l1/*?*
Disallow */l1*?*
Disallow */vpg_api.php
Disallow */rpt/L3-El/includes/api/*
Disallow */rpt/VPG-Hybrid/includes/api/*
Disallow */rpt/*
Disallow */s?q*
Disallow */a2c/*
Disallow /*.php
Disallow /*?proId*
Disallow *?cat=*
Disallow */c/*/b/*
Disallow */request/*
Disallow */shop-atc/*
Disallow */atc/*
Disallow */wa/*
Disallow */catalogsearch/result?q=*
Disallow */utils/
Disallow */zlib/
Disallow */lib/
Disallow */inftrees$
Disallow */inffast$
Disallow */trees$
Disallow */common$
Disallow */crc32$
Disallow */adler32$
Disallow */messages$
Disallow */gzheader$
Disallow */constants$
Disallow */deflate$
Disallow */zstream$
Disallow /*.pdf

liebaofast

Rule Path
Disallow /

ucbrowser

Rule Path
Disallow /

mqqbrowser

Rule Path
Disallow /

mb2345browser

Rule Path
Disallow /

cabot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

pingbot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

ru_bot

Rule Path
Disallow /

awariosmartbot

Rule Path
Disallow /

seznambot

Rule Path
Disallow /

bitsightbot

Rule Path
Disallow /

twitterbot

Rule Path
Disallow /

discordbot

Rule Path
Disallow /

redditbot

Rule Path
Disallow /

webprosbot

Rule Path
Disallow /

serpstatbot

Rule Path
Disallow /

dataforseobot

Rule Path
Disallow /

bitlybo

Rule Path
Disallow /

webwikibot

Rule Path
Disallow /

amazonbot

Rule Path
Disallow /

surdotlybot

Rule Path
Disallow /

netpeakcheckerbot

Rule Path
Disallow /

linkedinbot

Rule Path
Disallow /

linkdexbot

Rule Path
Disallow /

dongleemulatorbot

Rule Path
Disallow /

repolookoutbot

Rule Path
Disallow /

rogerbot

Rule Path
Disallow /

applebot

Rule Path
Disallow /

uk_lddc_bot

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

scrapy

Rule Path
Disallow /

icedragon

Rule Path
Disallow /

seekportbot

Rule Path
Disallow /

imagesiftbot

Rule Path
Disallow /

dataforseobot

Rule Path
Disallow /

adsbot-google

Rule Path
Allow /p*
Allow /pd*
Allow /b*
Allow /c*
Disallow */checkout*
Disallow */default*
Disallow */pramp*
Disallow */customer/*
Disallow */customers/*
Disallow */app/*
Disallow */rest/*
Disallow */visitorsreport/*
Disallow */getprice*
Disallow */brand-pages/save_mcmaster_contact.php
Disallow */l3_ajax.php
Disallow */l3_ajax_apollo.php
Disallow */l3_m_ajax.php
Disallow */bd_ajax.php
Disallow */bd_req.php
Disallow */bd_mail.php
Disallow */brand_request_quote_send_mail.php
Disallow */ajax_check.php
Disallow */smr_request_quote_helper.php
Disallow */smr_request_quote.php
Disallow */smr_hp_api.php
Disallow */smr_credit_mail.php
Disallow */smr_api.php
Disallow */request_quote_send_mail.php
Disallow */en-eu/*
Disallow */en/*
Disallow */bd_api.php
Disallow */smrCallBackMailer.php
Disallow */getCartDetail.php
Disallow */create_order_paypal.php
Disallow */vpg_mp_ajax.php
Disallow */category_api.php
Disallow */category_l3_dynamic.php
Disallow */bd_nkm_ft_m_tw_test.php
Disallow */pd/pd/*
Disallow */pd/p/*
Disallow */vpg_api.php
Disallow */rpt/L3-El/includes/api/*
Disallow */rpt/VPG-Hybrid/includes/api/*
Disallow */rpt/*
Disallow */l2/add_to_cart.php
Disallow */l2/add_to_cart_plus.php
Disallow */l2/add_to_cart_minus.php
Disallow */l1/*?*

baiduspider

Rule Path
Disallow /

yandexbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.raptorsupplies.co.uk/sitemaps/sitemap-index.xml
sitemap https://www.raptorsupplies.co.uk/sitemaps/sitemap-index-merge.xml
sitemap https://www.raptorsupplies.co.uk/sitemaps/sitemap-index-brand.xml