betting.com
robots.txt

Robots Exclusion Standard data for betting.com

Resource Scan

Scan Details

Site Domain betting.com
Base Domain betting.com
Scan Status Ok
Last Scan5/22/2025, 8:56:39 PM
Next Scan 6/21/2025, 8:56:39 PM

Last Scan

Scanned5/22/2025, 8:56:39 PM
URL https://betting.com/robots.txt
Domain IPs 104.21.20.211, 172.67.194.119, 2606:4700:3035::ac43:c277, 2606:4700:3037::6815:14d3
Response IP 172.67.194.119
Found Yes
Hash aa80510899b010503868cbebc4cde262a16bcb5fa8d97f84dc6b20a53433a06a
SimHash 69a0880184b1

Groups

*

Rule Path
Disallow /search/
Disallow /go/
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php

Other Records

Field Value
sitemap https://betting.com/wp-sitemap.xml
sitemap https://betting.com/de/wp-sitemap.xml
sitemap https://betting.com/gb/wp-sitemap.xml
sitemap https://betting.com/es/wp-sitemap.xml
sitemap https://betting.com/sv/wp-sitemap.xml
sitemap https://betting.com/br/wp-sitemap.xml

Comments

  • File loaded from repo during CICD
  • Line below opened up on 2023-10-17 so Google see we block spam
  • Disallow: /?s=