thenaturalrubycompany.com
robots.txt
Robots Exclusion Standard data for thenaturalrubycompany.com
Resource Scan
Scan Details
| Site Domain | thenaturalrubycompany.com |
| Base Domain | thenaturalrubycompany.com |
| Scan Status | Ok |
| Last Scan | 2024-11-04T03:27:13+00:00 |
| Next Scan | 2024-12-04T03:27:13+00:00 |
Last Scan
| Scanned | 2024-11-04T03:27:13+00:00 |
| URL | https://thenaturalrubycompany.com/robots.txt |
| Domain IPs | 108.156.133.110, 108.156.133.45, 108.156.133.52, 108.156.133.57 |
| Response IP | 108.156.133.57 |
| Found | Yes |
| Hash | 1c9e77ff4ccb49ec2dcac67d16e74dc45893e8dc657a0ac097cb48e8685ad49d |
| SimHash | 6431da7028db |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /featured-designers |
| Disallow | /account/ |
| Disallow | /account/reset-password/ |
| Disallow | /account/set-password/ |
| Disallow | /order-history/ |
| Disallow | /system_stone_data.json |
| Disallow | /system_stone_data_dev.json |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 2 |
Other Records
| Field | Value |
|---|---|
| sitemap | https://thenaturalrubycompany.com/sitemap.xml |