wigsdo.com
robots.txt
Robots Exclusion Standard data for wigsdo.com
Resource Scan
Scan Details
Site Domain | wigsdo.com |
Base Domain | wigsdo.com |
Scan Status | Failed |
Failure Stage | Fetching resource. |
Failure Reason | Server returned a client error. |
Last Scan | 2025-07-17T12:43:58+00:00 |
Next Scan | 2025-10-15T12:43:58+00:00 |
Last Successful Scan
Scanned | 2025-02-25T03:59:58+00:00 |
URL | https://wigsdo.com/robots.txt |
Redirect | https://www.wigsdo.com/robots.txt |
Redirect Domain | www.wigsdo.com |
Redirect Base | wigsdo.com |
Domain IPs | 104.21.48.44, 172.67.177.106, 2606:4700:3032::ac43:b16a, 2606:4700:3033::6815:302c |
Redirect IPs | 104.21.48.44, 172.67.177.106, 2606:4700:3032::ac43:b16a, 2606:4700:3033::6815:302c |
Response IP | 172.67.177.106 |
Found | Yes |
Hash | a83b6aa6b37f6084e37ad6d49d5afcc1214f8424b1c760bd6057089eb7a0203c |
SimHash | f369d7eec611 |
Groups
*
Rule | Path |
---|---|
Allow | / |
Disallow | /fpc/catalog_product/view/id/ |
Disallow | /*%2C*%2C*.html |
Disallow | /*%21*.html |
Disallow | /s/ |
Disallow | /catalog/ |
Disallow | /catalogsearch/ |
Disallow | /app/ |
Disallow | /cgi-bin/ |
Disallow | /downloader/ |
Disallow | /errors/ |
Disallow | /includes/ |
Disallow | /account/ |
Disallow | /lib/ |
Disallow | /magento/ |
Disallow | /pkginfo/ |
Disallow | /report/ |
Disallow | /scripts/ |
Disallow | /shell/ |
Disallow | /stats/ |
Disallow | /var/ |
Disallow | /index.php/ |
Disallow | /checkout/ |
Disallow | /control/ |
Disallow | /contacts/ |
Disallow | /customer/ |
Disallow | /customize/ |
Disallow | /newsletter/ |
Disallow | /contact-us/ |
Disallow | /review/ |
Disallow | /sendfriend/ |
Disallow | /wishlist/ |
Disallow | /directory/ |
Disallow | /help/ |
Disallow | /webhelper/ |
Disallow | /wp-admin/ |
Other Records
Field | Value |
---|---|
sitemap | https://www.wigsdo.com/sitemap.xml |