bestbetcasino.com
robots.txt

Robots Exclusion Standard data for bestbetcasino.com

Resource Scan

Scan Details

Site Domain bestbetcasino.com
Base Domain bestbetcasino.com
Scan Status Ok
Last Scan2024-06-11T17:01:24+00:00
Next Scan 2024-06-18T17:01:24+00:00

Last Scan

Scanned2024-06-11T17:01:24+00:00
URL https://bestbetcasino.com/robots.txt
Domain IPs 3.222.241.21, 34.193.198.171, 44.212.192.5, 52.1.29.224
Response IP 44.212.192.5
Found Yes
Hash 4cb358effe6c9bebd9686438e8f99524655a127244fa9590b1421e67c5ca7c79
SimHash 7c4d9b5526b2

Groups

*

Rule Path
Disallow /wp-admin/
Disallow /wp-includes/
Disallow /wp-content/plugins/
Disallow /wp-content/themes/
Disallow /wp-login.php
Disallow /xmlrpc.php

googlebot
bingbot
siteauditbot

Rule Path
Allow /

*

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.bestbetcasino.com/sitemap_index.xml

Comments

  • Disallow WordPress core files and directories
  • Allow SEO crawlers
  • Add other SEO crawler user-agents here as needed
  • Disallow all other crawlers