Log In Sign Up

rollaclub.com
robots.txt

Robots Exclusion Standard data for rollaclub.com

Resource Scan

Scan Details

Site Domain rollaclub.com
Base Domain rollaclub.com
Scan Status Ok
Last Scan2024-09-29T06:35:30+00:00
Next Scan 2024-10-06T06:35:30+00:00

Last Scan

Scanned2024-09-29T06:35:30+00:00
URL https://rollaclub.com/robots.txt
Domain IPs 104.21.92.161, 172.67.195.175, 2606:4700:3033::6815:5ca1, 2606:4700:3033::ac43:c3af
Response IP 172.67.195.175
Found Yes
Hash c59c47fc5e2160492d43da2f78ffc2749a1dbda6b31d36ce5d6430f112366dae
SimHash 4c1dd183e6e0

Groups

mediapartners-google*

Rule Path
Disallow /board/applications/core/interface/imageproxy/imageproxy.php?img=*

*

Rule Path
Disallow /board/admin/
Disallow /board/applications/core/interface/imageproxy/imageproxy.php?img=*

Other Records

Field Value
crawl-delay 5

baiduspider

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

applebot-extended

Rule Path
Disallow /
Back to top

Comments

  • Rollaclub.com robots.txt
  • "Any empty [Disallow] value, indicates that all URLs can be retrieved.
  • At least one Disallow field needs to be present in a record."
  • Baiduspider
  • Applebot LLM disallow
Back to top