competize.com
robots.txt
Robots Exclusion Standard data for competize.com
Resource Scan
Scan Details
Site Domain | competize.com |
Base Domain | competize.com |
Scan Status | Ok |
Last Scan | 2024-09-22T18:35:52+00:00 |
Next Scan | 2024-09-29T18:35:52+00:00 |
Last Scan
Scanned | 2024-09-22T18:35:52+00:00 |
URL | https://competize.com/robots.txt |
Domain IPs | 2a05:d018:22b:900:4cbf:a15:a37c:baaf, 54.217.191.128 |
Response IP | 54.217.191.128 |
Found | Yes |
Hash | 45b5ee26eecabd7ad844085ab7cf314cd29d7af057fd9f96304f0cbf184c1a64 |
SimHash | ac4b59054591 |
Groups
*
Rule | Path |
---|---|
Disallow | /cgi-bin/ |
Disallow | /data/ |
Disallow | /logs/ |
Disallow | /docs/ |
Disallow | /files/ |
Disallow | /vendor/ |
Disallow | /newsletter_uploads/ |
Disallow | /print/ |
Disallow | /devs/ |
Disallow | /sitemaps/ |
Disallow | sitemap.xml |
Disallow | composer.* |
Comments