ubet.io
robots.txt

Robots Exclusion Standard data for ubet.io

Resource Scan

Scan Details

Site Domain ubet.io
Base Domain ubet.io
Scan Status Ok
Last Scan2024-06-10T02:58:35+00:00
Next Scan 2024-07-10T02:58:35+00:00

Last Scan

Scanned2024-06-10T02:58:35+00:00
URL https://ubet.io/robots.txt
Domain IPs 104.26.8.86, 104.26.9.86, 172.67.74.49, 2606:4700:20::681a:856, 2606:4700:20::681a:956, 2606:4700:20::ac43:4a31
Response IP 172.67.74.49
Found Yes
Hash 4bc83baf5657dc0d22eef70e864f5526ab7dc30dc6df0f1c47cfb3d3658faccd
SimHash 0d51d7006771

Groups

*

Rule Path
Disallow /my
Disallow /_data
Disallow /en/_data

*

Rule Path
Allow /

Comments

  • Allow all crawlers