shoe.org
robots.txt
Robots Exclusion Standard data for shoe.org
Resource Scan
Scan Details
| Site Domain | shoe.org |
| Base Domain | shoe.org |
| Scan Status | Ok |
| Last Scan | 2024-05-31T16:04:26+00:00 |
| Next Scan | 2024-06-07T16:04:26+00:00 |
Last Scan
| Scanned | 2024-05-31T16:04:26+00:00 |
| URL | https://www.shoe.org/robots.txt |
| Response IP | 31.171.244.133 |
| Found | Yes |
| Hash | df1869bb88ecf8b89f4595aea844aa91aa02476a033dc7f05cf2dbd1e9647966 |
| SimHash | 415cdd60e643 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /usage/ |
| Disallow | /s/ |
| Disallow | /accounts/ |
| Disallow | /lesbian-community/gallery/ |
| Disallow | /lesben-community/gallery/ |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 20 |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.shoe.org/sitemap/sitemap.php |
| sitemap | https://de.shoe.org/sitemap/sitemap.php |
| sitemap | https://at.shoe.org/sitemap/sitemap.php |
| sitemap | https://www.shoe.ch/sitemap/sitemap.php |
| sitemap | https://www.lesbianonlinecommunity.com/sitemap/sitemap.php |