petcorner.ru
robots.txt
Robots Exclusion Standard data for petcorner.ru
Resource Scan
Scan Details
Site Domain | petcorner.ru |
Base Domain | petcorner.ru |
Scan Status | Ok |
Last Scan | 2024-08-29T04:01:39+00:00 |
Next Scan | 2024-09-28T04:01:39+00:00 |
Last Scan
Scanned | 2024-08-29T04:01:39+00:00 |
URL | https://petcorner.ru/robots.txt |
Redirect | http://petcorner.ru/robots.txt |
Domain IPs | 104.21.79.183, 172.67.147.9, 2606:4700:3036::6815:4fb7, 2606:4700:3036::ac43:9309 |
Response IP | 172.67.147.9 |
Found | Yes |
Hash | d048f3425f88f226d121439cc9baebdcc87be988ae6a9dada953934af5a5b905 |
SimHash | 550fd3749ee0 |
Groups
googlebot
Rule | Path |
---|---|
Allow | /wp-content/themes/*.css |
Allow | /wp-content/themes/*.js |
Allow | /wp-content/themes/*.css* |
Allow | /wp-content/themes/*.js* |
Allow | /wp-content/themes/*/js/*?* |
Allow | /wp-content/*.png |
Allow | /wp-content/*.jpg |
Disallow | /wp-login.php |
Disallow | /wp-register.php |
Disallow | /cgi-bin/ |
Disallow | /uncategorized/ |
Disallow | /author/ |
Disallow | /wp-json/ |
Disallow | */feed/ |
Disallow | */trackback/ |
Disallow | /*?* |
Disallow | */turbo/* |
Other Records
Field | Value |
---|---|
sitemap | http://petcorner.ru/sitemap.xml |