cllct.com
robots.txt
Robots Exclusion Standard data for cllct.com
Resource Scan
Scan Details
Site Domain | cllct.com |
Base Domain | cllct.com |
Scan Status | Ok |
Last Scan | 2024-10-28T01:36:39+00:00 |
Next Scan | 2024-11-04T01:36:39+00:00 |
Last Scan
Scanned | 2024-10-28T01:36:39+00:00 |
URL | https://cllct.com/robots.txt |
Redirect | https://www.cllct.com/robots.txt |
Redirect Domain | www.cllct.com |
Redirect Base | cllct.com |
Domain IPs | 13.33.88.3, 13.33.88.32, 13.33.88.57, 13.33.88.84 |
Redirect IPs | 13.33.88.3, 13.33.88.32, 13.33.88.57, 13.33.88.84, 2600:9000:223b:4800:1b:d2ee:3180:93a1, 2600:9000:223b:600:1b:d2ee:3180:93a1, 2600:9000:223b:6400:1b:d2ee:3180:93a1, 2600:9000:223b:6e00:1b:d2ee:3180:93a1, 2600:9000:223b:c400:1b:d2ee:3180:93a1, 2600:9000:223b:c800:1b:d2ee:3180:93a1, 2600:9000:223b:d600:1b:d2ee:3180:93a1, 2600:9000:223b:f600:1b:d2ee:3180:93a1 |
Response IP | 13.33.88.57 |
Found | Yes |
Hash | 05f698c4411cda66710f5f2459038fc47c6c82ebf08a20a70fa8175ec3dfd963 |
SimHash | 6015d9c2a592 |
Groups
*
Rule | Path |
---|---|
Disallow | /sports-collectibles/posts/ |
Disallow | /sports-collectibles/pages/ |
Disallow | /strapi/ |
Disallow | /search/ |
Other Records
Field | Value |
---|---|
sitemap | https://www.cllct.com/sitemap-index.xml |