clofertas.com
robots.txt
Robots Exclusion Standard data for clofertas.com
Resource Scan
Scan Details
Site Domain | clofertas.com |
Base Domain | clofertas.com |
Scan Status | Ok |
Last Scan | 2024-11-13T16:20:36+00:00 |
Next Scan | 2024-11-20T16:20:36+00:00 |
Last Scan
Scanned | 2024-11-13T16:20:36+00:00 |
URL | https://clofertas.com/robots.txt |
Redirect | https://www.clofertas.com/robots.txt |
Redirect Domain | www.clofertas.com |
Redirect Base | clofertas.com |
Domain IPs | 104.21.73.62, 172.67.188.228, 2606:4700:3031::ac43:bce4, 2606:4700:3035::6815:493e |
Redirect IPs | 104.21.73.62, 172.67.188.228, 2606:4700:3031::ac43:bce4, 2606:4700:3035::6815:493e |
Response IP | 172.67.188.228 |
Found | Yes |
Hash | 82aaa34e47bca98c21686218fb145c1bb1cba9e9a359d33cd751a842536531a6 |
SimHash | c11659100430 |
Groups
*
Rule | Path |
---|---|
Disallow | /cache/ |
Disallow | /core/ |
Disallow | /front/ |
Disallow | /smarty_configs/ |
Disallow | /vendor/ |
Disallow | /verify/ |
Disallow | /search/ |
Disallow | /go-*.html* |
Disallow | /composer.json |
Disallow | /composer.lock |
Disallow | /apple-touch-icon.png |
Disallow | /gold/amiaward.gif |
Disallow | /apple-touch-icon-precomposed.png |
Disallow | /acclaim/top_state_ad_center.js |
Disallow | /*?promoid=* |
Disallow | /*?showcoupert=* |
Other Records
Field | Value |
---|---|
sitemap | https://www.clofertas.com/clofertas_sitemap.xml |
Warnings
- 2 invalid lines.