horseracing.yardbarker.com
robots.txt

Robots Exclusion Standard data for horseracing.yardbarker.com

Resource Scan

Scan Details

Site Domain horseracing.yardbarker.com
Base Domain yardbarker.com
Scan Status Ok
Last Scan2024-06-20T13:56:31+00:00
Next Scan 2024-07-20T13:56:31+00:00

Last Scan

Scanned2024-06-20T13:56:31+00:00
URL http://horseracing.yardbarker.com/robots.txt
Redirect https://www.yardbarker.com/robots.txt
Redirect Domain www.yardbarker.com
Redirect Base yardbarker.com
Domain IPs 52.40.106.59
Redirect IPs 13.226.2.13, 13.226.2.14, 13.226.2.61, 13.226.2.75
Response IP 18.165.171.61
Found Yes
Hash 2e17560ed11957b521719e6097dcf9d3fd46910fadb8a630088bcb119dada695
SimHash 81330bb76dd2

Groups

*

Rule Path
Disallow /players/*
Disallow /users/*
Disallow /forum/*
Disallow /account/*
Disallow /author/new/*
Disallow /quiz/embed/*
Disallow /quiz/results/*
Disallow /quiz/save_score/*
Disallow /asset/*
Disallow /widget/*
Disallow /articles/insert_inline_editor
Disallow /newsletter/popup_promo*
Disallow /content/grid_footer_feed*
Disallow /search/auto_complete*
Disallow /rss/*