spoiledcatreviews.com
robots.txt
Robots Exclusion Standard data for spoiledcatreviews.com
Resource Scan
Scan Details
Site Domain | spoiledcatreviews.com |
Base Domain | spoiledcatreviews.com |
Scan Status | Ok |
Last Scan | 2024-11-15T08:51:14+00:00 |
Next Scan | 2024-11-22T08:51:14+00:00 |
Last Scan
Scanned | 2024-11-15T08:51:14+00:00 |
URL | https://spoiledcatreviews.com/robots.txt |
Redirect | https://www.spoiledcatreviews.com/robots.txt |
Redirect Domain | www.spoiledcatreviews.com |
Redirect Base | spoiledcatreviews.com |
Domain IPs | 104.21.2.130, 172.67.129.60, 2606:4700:3034::ac43:813c, 2606:4700:3037::6815:282 |
Redirect IPs | 104.21.2.130, 172.67.129.60, 2606:4700:3034::ac43:813c, 2606:4700:3037::6815:282 |
Response IP | 172.67.129.60 |
Found | Yes |
Hash | 7e880479288e414aa3064b116333cabb02d34e0da92ac452cf1c5991cb42833a |
SimHash | 410499900430 |
Groups
googlebot
Rule | Path |
---|---|
Disallow | /ads.txt |
Disallow | /cache/ |
Disallow | /core/ |
Disallow | /front/ |
Disallow | /smarty_configs/ |
Disallow | /vendor/ |
Disallow | /verify/ |
Disallow | /search/ |
Disallow | /go-*.html* |
Disallow | /composer.json |
Disallow | /composer.lock |
Disallow | /apple-touch-icon.png |
Disallow | /gold/amiaward.gif |
Disallow | /apple-touch-icon-precomposed.png |
Disallow | /acclaim/top_state_ad_center.js |
Disallow | /*?promoid=* |
Disallow | /*?showcoupert=* |
*
Rule | Path |
---|---|
Disallow | /cache/ |
Disallow | /core/ |
Disallow | /front/ |
Disallow | /smarty_configs/ |
Disallow | /vendor/ |
Disallow | /verify/ |
Disallow | /search/ |
Disallow | /go-*.html* |
Disallow | /composer.json |
Disallow | /composer.lock |
Disallow | /apple-touch-icon.png |
Disallow | /gold/amiaward.gif |
Disallow | /apple-touch-icon-precomposed.png |
Disallow | /acclaim/top_state_ad_center.js |
Disallow | /*?promoid=* |
Disallow | /*?showcoupert=* |
Other Records
Field | Value |
---|---|
sitemap | https://www.spoiledcatreviews.com/spoiledcatreviews_sitemap.xml |
Warnings
- 2 invalid lines.