horseclicks.com
robots.txt

Robots Exclusion Standard data for horseclicks.com

Resource Scan

Scan Details

Site Domain horseclicks.com
Base Domain horseclicks.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-10-24T01:21:13+00:00
Next Scan 2026-01-22T01:21:13+00:00

Last Successful Scan

Scanned2024-09-29T21:35:07+00:00
URL https://horseclicks.com/robots.txt
Redirect https://www.horseclicks.com/robots.txt
Redirect Domain www.horseclicks.com
Redirect Base horseclicks.com
Domain IPs 104.26.8.132, 104.26.9.132, 172.67.73.129, 2606:4700:20::681a:884, 2606:4700:20::681a:984, 2606:4700:20::ac43:4981
Redirect IPs 104.26.8.132, 104.26.9.132, 172.67.73.129, 2606:4700:20::681a:884, 2606:4700:20::681a:984, 2606:4700:20::ac43:4981
Response IP 104.26.8.132
Found Yes
Hash dbd5416003e257debe368957f2ca0dbe57108b2bbd0516ecc8d867a1ce30c3b8
SimHash ba0948522673

Groups

*

Rule Path
Disallow /*list-all-adverts*
Disallow /*?sstr*
Disallow /*?ads_pa*
Disallow /print_ad.php
Disallow /ads_print.php
Disallow /print_ad_payment.php
Disallow /print_voucher.php
Disallow /print_terms.php
Disallow /*op%3D*
Disallow /members.php*
Disallow /member/*
Disallow /member.php*
Disallow /*ads_i*
Disallow /*ads_v*
Disallow /*ads_pid*
Disallow /*list_type*
Disallow /*ads_tp*
Disallow /*ads_y*
Disallow /*cmonth*
Disallow /*cyear*
Disallow /*view_mode*
Disallow /*order_advice*
Disallow /*ads_maid*
Disallow /*ads_c*
Disallow /*ads_ctid*
Disallow /*url%3Dmaxdim*
Disallow /*ads_nw*
Disallow /*cat_id*
Disallow /*sec_id*
Disallow /*ads_berth*
Disallow /*order*
Disallow /*qf_cat*
Disallow /*accfnw*
Disallow /*accfrl*
Disallow /*accfpp*
Disallow /*radius*
Disallow /*ads_gid*
Disallow /*ads_coid*
Disallow /*ads_did*
Disallow /*ads_r*
Disallow /*ads_ct*
Disallow /*ads_mr*
Disallow /*ads_cid*
Disallow /*ads_bid*
Disallow /*ads_pt*
Disallow /*ads_nhid*
Disallow /*ads_disc*
Disallow /*ads_style*
Disallow /*ads_contract*
Disallow /*/AJ/*
Disallow /*/EJ/*
Disallow /*/FJ/*
Disallow /*/IJ/*
Disallow /*/JL/*
Disallow /*_test_email_lang*
Disallow /*/JM/*
Disallow /*/AEJ/*
Disallow /*/AFJ/*
Disallow /*/AIJ/*
Disallow /*/AJL/*
Disallow /*/AJM/*
Disallow /*/EFJ/*
Disallow /*/EIJ/*
Disallow /*/EJL/*
Disallow /*/EJM/*
Disallow /*/FIJ/*
Disallow /*/FJL/*
Disallow /*/FJM/*
Disallow /*/IJL/*
Disallow /*/IJM/*
Disallow /*/JLM/*
Disallow /*/for-sale/L/horses-for-sale*
Disallow /*/for-sale/CL/horses-for-sale*
Disallow /*/for-sale/ACL/horses-for-sale*
Disallow /*/for-sale/CIL/horses-for-sale*
Disallow /*for-sale/CFL/horses-for-sale*
Disallow /*/for-sale/CEL/horses-for-sale*
Disallow /*/for-sale/united-states/CLM/horses-for-sale*
Disallow /*/for-sale/canada/CLM/horses-for-sale*
Disallow /*/for-sale/AL/horses-for-sale*
Disallow /*/for-sale/AIL/horses-for-sale*
Disallow /*/for-sale/AFL/horses-for-sale*
Disallow /*/for-sale/AEL/horses-for-sale*
Disallow /*/for-sale/united-states/ALM/horses-for-sale*
Disallow /*/for-sale/canada/ALM/horses-for-sale*
Disallow /*/for-sale/IL/horses-for-sale*
Disallow /*/for-sale/FIL/horses-for-sale*
Disallow /*/for-sale/EIL/horses-for-sale*
Disallow /*/for-sale/united-states/ILM/horses-for-sale*
Disallow /*/for-sale/canada/ILM/horses-for-sale*
Disallow /*/for-sale/FL/horses-for-sale*
Disallow /*/for-sale/EFL/horses-for-sale*
Disallow /*/for-sale/united-states/FLM/horses-for-sale*
Disallow /*/for-sale/canada/FLM/horses-for-sale*
Disallow /*/for-sale/EL/horses-for-sale*
Disallow /*/for-sale/united-states/ELM/horses-for-sale*
Disallow /*/for-sale/canada/ELM/horses-for-sale*
Disallow /*/united-states/LM/horses-for-sale*
Disallow /*/canada/LM/horses-for-sale*
Disallow /*/united-states/M/horses-for-sale*
Disallow /*/united-states/CM/horses-for-sale*
Disallow /*/united-states/AM/horses-for-sale*
Disallow /*/united-states/IM/horses-for-sale*
Disallow /*/united-states/FM/horses-for-sale*
Disallow /*/united-states/EM/horses-for-sale*
Disallow /*/united-states/ACM/horses-for-sale*
Disallow /*/united-states/CIM/horses-for-sale*
Disallow /*/united-states/CFM/horses-for-sale*
Disallow /*/united-states/CEM/horses-for-sale*
Disallow /*/united-states/AIM/horses-for-sale*
Disallow /*/united-states/AFM/horses-for-sale*
Disallow /*/united-states/AEM/horses-for-sale*
Disallow /*/united-states/FIM/horses-for-sale*
Disallow /*/united-states/EIM/horses-for-sale*
Disallow /*/united-states/EFM/horses-for-sale*
Disallow /*email_stats_id*
Disallow /*ads_atid*
Disallow /*name%3Djsoup*
Disallow /*msclkid*
Disallow /*tag_id*
Disallow /*tag%3D*
Disallow /*?id=*
Disallow /*%26id%3D*
Disallow /*ads_lid*
Disallow /*langage%3D*
Disallow /*ads_zip*
Disallow /*dm_i*
Disallow /*ads_aid*
Disallow /*gad_source*
Disallow /*fbclid*
Disallow /*temp_id*
Disallow /*ad_id*
Disallow /*predicted_id*
Disallow /*trace_banners*
Disallow /*perpage%3D*
Disallow /*nosoldads%3D*
Disallow /*ads_l%3D*
Disallow /*adid%3D*
Disallow /*ads_aid%3D*
Disallow /*ads_hid%3D*
Disallow /*gad%3D*
Disallow /*ads_xxx*
Disallow /*gclid*
Disallow /*pedigree%3D*
Disallow /*wgl%3D*
Disallow /*ads_st%3D*
Disallow /*ads_rid*

Other Records

Field Value
crawl-delay 5

Other Records

Field Value
sitemap https://www.horseclicks.com/map/sitemap_index_main.xml
sitemap https://www.horseclicks.com/map/sitemap_index_ads.xml
sitemap https://www.horseclicks.com/map/sitemap_index_cities.xml
sitemap https://www.horseclicks.com/map/sitemap_index_regions.xml
sitemap https://www.horseclicks.com/map/sitemap_index_default.xml

Comments

  • Filter Combinations
  • Parameters found in Crawled Not Indexed in GSC
  • Additional parameters found in crawl to be blocked
  • Additional parameters found in Soft 404s in GSC