sirdar.com
robots.txt
Robots Exclusion Standard data for sirdar.com
Resource Scan
Scan Details
| Site Domain | sirdar.com |
| Base Domain | sirdar.com |
| Scan Status | Ok |
| Last Scan | 2025-10-06T09:59:33+00:00 |
| Next Scan | 2025-11-05T09:59:33+00:00 |
Last Scan
| Scanned | 2025-10-06T09:59:33+00:00 |
| URL | https://sirdar.com/robots.txt |
| Domain IPs | 13.248.244.96, 35.71.179.82, 75.2.60.68, 99.83.220.108 |
| Response IP | 13.248.244.96 |
| Found | Yes |
| Hash | a5e4aded35dc4bd72ab4201c80a2081a7d01e9944f24eff3aca8e9cf41e9bf53 |
| SimHash | c1114e722903 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /*/checkout |
| Disallow | /*/cart |
| Disallow | /*/orders |
| Disallow | /user |
| Disallow | /*/account |
| Disallow | /*/login |
| Disallow | /api |
| Disallow | /password |
| Disallow | /shop |
| Disallow | /*? |
| Allow | /*?page |
| Allow | /*?taxon_id |
| Disallow | /*/knit-your-own |
| Disallow | /*/made-by-the-gang |
| Disallow | /*/crochet-your-own |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.woolandthegang.com/en/sitemap.xml.gz |
| sitemap | https://www.woolandthegang.com/de/sitemap.xml.gz |
| sitemap | https://www.woolandthegang.com/fr/sitemap.xml.gz |