rubic.us
robots.txt
Robots Exclusion Standard data for rubic.us
Resource Scan
Scan Details
Site Domain | rubic.us |
Base Domain | rubic.us |
Scan Status | Ok |
Last Scan | 2024-09-28T21:29:59+00:00 |
Next Scan | 2024-10-05T21:29:59+00:00 |
Last Scan
Scanned | 2024-09-28T21:29:59+00:00 |
URL | https://rubic.us/robots.txt |
Domain IPs | 104.22.54.148, 104.22.55.148, 172.67.26.202, 2606:4700:10::6816:3694, 2606:4700:10::6816:3794, 2606:4700:10::ac43:1aca |
Response IP | 104.22.54.148 |
Found | Yes |
Hash | c0eef5917596a5478d624c1405138a652d39ca53a52903dcc5cb1604842d0d6f |
SimHash | cb615d5c0394 |
Groups
googlebot
Rule | Path |
---|---|
Disallow | /wp-admin/ |
Disallow | /wp-trackback |
Disallow | /wp-feed |
Disallow | /wp-comments |
Disallow | /wp-login.php |
Disallow | /wp-register.php |
Disallow | */trackback |
Disallow | */feed |
Disallow | /cgi-bin |
Allow | *?* |
Allow | /wp-content/ |
Allow | /wp-includes/ |
*
Rule | Path |
---|---|
Disallow | /wp-admin/ |
Disallow | /wp-trackback |
Disallow | /wp-feed |
Disallow | /wp-comments |
Disallow | /wp-login.php |
Disallow | /wp-register.php |
Disallow | */trackback |
Disallow | */feed |
Disallow | /cgi-bin |
Disallow | /law/ |
Disallow | *?* |
Allow | /wp-content/ |
Allow | /wp-includes/ |
Other Records
Field | Value |
---|---|
sitemap | https://rubic.us/sitemap_index.xml |