Log In Sign Up

kubet.ai
robots.txt

Robots Exclusion Standard data for kubet.ai

Resource Scan

Scan Details

Site Domain kubet.ai
Base Domain kubet.ai
Scan Status Ok
Last Scan2025-06-09T17:34:30+00:00
Next Scan 2025-07-09T17:34:30+00:00

Last Scan

Scanned2025-06-09T17:34:30+00:00
URL https://kubet.ai/robots.txt
Domain IPs 104.21.21.44, 172.67.196.101, 2606:4700:3032::6815:152c, 2606:4700:3037::ac43:c465
Response IP 172.67.196.101
Found Yes
Hash c1635cbe202e10a757dc5ffa850893111a0f1014bb338151d278d2b60fc9d031
SimHash e910c9784821

Groups

*
googlebot-mobile

Rule Path
Allow /
Allow /wp-admin/admin-ajax.php

*

Rule Path
Allow /*.js$
Allow /*.css$

googlebot-image

Rule Path
Allow /wp-content/uploads/
Disallow /wp-admin/
Disallow /cgi-bin/
Disallow /tmp/
Disallow /images/
Disallow /dev/
Disallow /wp-includes/
Disallow /signup/
Disallow /author
Disallow /link/
Disallow /feed/
Disallow /comments/feed/
Back to top