bookmakersreview.com
robots.txt

Robots Exclusion Standard data for bookmakersreview.com

Resource Scan

Scan Details

Site Domain bookmakersreview.com
Base Domain bookmakersreview.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-10-05T09:00:43+00:00
Next Scan 2025-01-03T09:00:43+00:00

Last Successful Scan

Scanned2023-02-20T23:52:58+00:00
URL https://bookmakersreview.com/robots.txt
Domain IPs 13.33.88.12, 13.33.88.124, 13.33.88.66, 13.33.88.81
Response IP 13.33.88.12
Found Yes
Hash 63c997d88eec26d77aa3c206483f3e3b7fff10c8bcd287f3caa8d9ed83366ef5
SimHash 62d49d8bc0f2

Groups

*

Rule Path
Allow /wp-admin/admin-ajax.php
Allow /wp-content/uploads/
Disallow /wp-content/plugins/
Disallow /wp-admin/
Disallow /wp-login.php
Disallow /readme.html
Disallow /refer/
Disallow /?s=
Disallow /search/
Disallow /members/

googlebot

Rule Path
Allow /*.css$
Allow /*.js$

bingbot

Rule Path
Allow /*.css$
Allow /*.js$

googlebot-image

Rule Path
Allow /wp-content/uploads/

adsbot-google

Rule Path
Allow /

googlebot-mobile

Rule Path
Allow /
Disallow /forum/attachments/
Disallow /forum/forums/*/?direction
Disallow /forum/forums/*/?order
Disallow /forum/help/
Disallow /forum/login/
Disallow /forum/lost-password/
Disallow /forum/members/
Disallow /forum/misc/
Disallow /forum/online/
Disallow /forum/register/
Disallow /forum/search/

Other Records

Field Value
sitemap https://bookmakersreview.com/sitemap-events.xml
sitemap https://bookmakersreview.com/sitemap-leagues.xml
sitemap https://bookmakersreview.com/forum/sitemap.xml
sitemap https://www.bookmakersreview.com/sitemap_index.xml
sitemap https://www.bookmakersreview.com/author-sitemap.xml

Comments

  • giving access to CSS and JS files for a correct rendering process
  • List of specific google bots to be admitted
  • all related to forum
  • List of sitemaps