galleries.com
robots.txt
Robots Exclusion Standard data for galleries.com
Resource Scan
Scan Details
| Site Domain | galleries.com |
| Base Domain | galleries.com |
| Scan Status | Ok |
| Last Scan | 2024-09-15T19:12:04+00:00 |
| Next Scan | 2024-09-22T19:12:04+00:00 |
Last Scan
| Scanned | 2024-09-15T19:12:04+00:00 |
| URL | https://galleries.com/robots.txt |
| Domain IPs | 13.33.88.116, 13.33.88.119, 13.33.88.56, 13.33.88.9, 2600:9000:21e1:5c00:e:1321:a000:93a1, 2600:9000:21e1:6000:e:1321:a000:93a1, 2600:9000:21e1:6c00:e:1321:a000:93a1, 2600:9000:21e1:7a00:e:1321:a000:93a1, 2600:9000:21e1:800:e:1321:a000:93a1, 2600:9000:21e1:b200:e:1321:a000:93a1, 2600:9000:21e1:c400:e:1321:a000:93a1, 2600:9000:21e1:d600:e:1321:a000:93a1 |
| Response IP | 13.33.88.9 |
| Found | Yes |
| Hash | 299a20d1625b60f3b811a2a73373d7f32d96b20c24ab431a2186535eb099523a |
| SimHash | fe9a99698795 |
Groups
*
| Rule | Path | Comment |
|---|---|---|
| Disallow | /scripts/item.exe?LIST%2B* | - |
| Disallow | /scripts/item.exe?ENLARGE%2B* | - |
| Disallow | /scripts/item.exe?ENLARGEC%2B* | - |
| Disallow | /scripts/ | these are programs |
| Disallow | /temp/ | these are temporary and meaningless for an index |
| Disallow | /icons/ | no value in indexing this stuff! |
| Disallow | /misc/ | we put things here that are not interesting search material |
| Disallow | /bizrate/ | iframes for shopzilla ads, no need to index or follow these links |
| Disallow | /shareasale/ | iframes for shareasale ads, no need to index or follow these links |
| Disallow | /j4m/ | - |
| Disallow | /dlc.htm | - |
| Disallow | /AGI.htm | - |
| Disallow | /albert.htm | - |
| Disallow | /sanborn.htm | - |
| Disallow | /terran.htm | - |
| Disallow | /feedback.htm | - |
| Disallow | /forsale.htm | - |
| Allow | /minerals/ | - |
| Allow | /books/ | - |
| Allow | /rocks/ | - |
| Disallow | /jewelry/ | - |
Other Records
| Field | Value |
|---|---|
| sitemap | https://galleries.com/html_sitemap.xml |
Comments