pemnet.com
robots.txt
Robots Exclusion Standard data for pemnet.com
Resource Scan
Scan Details
| Site Domain | pemnet.com |
| Base Domain | pemnet.com |
| Scan Status | Ok |
| Last Scan | 2025-08-08T12:55:28+00:00 |
| Next Scan | 2025-09-07T12:55:28+00:00 |
Last Scan
| Scanned | 2025-08-08T12:55:28+00:00 |
| URL | https://pemnet.com/robots.txt |
| Domain IPs | 104.18.0.231, 104.18.1.231, 2606:4700::6812:1e7, 2606:4700::6812:e7 |
| Response IP | 104.18.1.231 |
| Found | Yes |
| Hash | 68814a96dd13744489bfa879ea9f097cd9c555e31d0eea0c61f05b654bd6a7d7 |
| SimHash | 45948988fc32 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /products/product-finder/? |
| Disallow | /resources/request-a-sample/?sku= |
| Disallow | /resources/download-center/? |
| Disallow | /search-results/? |
| Disallow | /inventory-search/? |
| Disallow | /inv/inventorylist.php? |
| Allow | /products/product-finder/?paged= |
| Disallow | /*/products/product-finder/? |
| Disallow | /*/resources/request-a-sample/?sku= |
| Disallow | /*/resources/download-center/? |
| Disallow | /*/search-results/? |
| Disallow | /*/inventory-search/? |
| Disallow | /*/inv/inventorylist.php? |
| Disallow | /wp-login.php |
| Allow | /*/products/product-finder/?paged=* |
*
| Rule | Path |
|---|---|
| Disallow |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.pemnet.com/sitemap_index.xml |
| sitemap | https://www.pemnet.com/eu/sitemap_index.xml |
| sitemap | https://www.pemnet.com/de/sitemap_index.xml |
| sitemap | https://www.pemnet.com/cn/sitemap_index.xml |
| sitemap | https://www.pemnet.com/es-mx/sitemap_index.xml |
| sitemap | https://www.pemnet.com/jp/sitemap_index.xml |
Comments