horsebetting.com
robots.txt

Robots Exclusion Standard data for horsebetting.com

Resource Scan

Scan Details

Site Domain horsebetting.com
Base Domain horsebetting.com
Scan Status Ok
Last Scan2025-03-16T03:47:17+00:00
Next Scan 2025-04-15T03:47:17+00:00

Last Scan

Scanned2025-03-16T03:47:17+00:00
URL https://horsebetting.com/robots.txt
Redirect https://www.horsebetting.com/robots.txt
Redirect Domain www.horsebetting.com
Redirect Base horsebetting.com
Domain IPs 104.21.58.161, 172.67.205.104, 2606:4700:3035::6815:3aa1, 2606:4700:3035::ac43:cd68
Redirect IPs 104.21.58.161, 172.67.205.104, 2606:4700:3035::6815:3aa1, 2606:4700:3035::ac43:cd68
Response IP 104.21.58.161
Found Yes
Hash b663a5f8e003a4e05c2b6142b53c01a563b6e30a3a62f2c2819f9809d39f8f0e
SimHash a504db048893

Groups

*

Rule Path
Disallow /cdn-cgi/*
Disallow /glv-trace/*
Disallow /go/*
Disallow /*?*s=*
Disallow /goto/*
Disallow /wp-admin/*
Allow /wp-admin/admin-ajax.php
Disallow /us/glv-trace/*
Disallow /us/go/*
Disallow /us/*?*s=*
Disallow /us/goto/*
Disallow /us/wp-admin/*
Allow /us/wp-admin/admin-ajax.php
Disallow /au/glv-trace/*
Disallow /au/go/*
Disallow /au/*?*s=*
Disallow /au/goto/*
Disallow /au/wp-admin/*
Allow /au/wp-admin/admin-ajax.php
Disallow /ca/glv-trace/*
Disallow /ca/go/*
Disallow /ca/*?*s=*
Disallow /ca/goto/*
Disallow /ca/wp-admin/*
Allow /ca/wp-admin/admin-ajax.php

*

Rule Path
Allow /go/boylesports/sport/

Other Records

Field Value
sitemap https://www.horsebetting.com/sitemap_index.xml
sitemap https://www.horsebetting.com/us/sitemap_index.xml
sitemap https://www.horsebetting.com/au/sitemap_index.xml
sitemap https://www.horsebetting.com/ca/sitemap_index.xml