meds4gen.com
robots.txt
Robots Exclusion Standard data for meds4gen.com
Resource Scan
Scan Details
| Site Domain | meds4gen.com |
| Base Domain | meds4gen.com |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Couldn't connect to server. |
| Last Scan | 2025-12-04T10:55:31+00:00 |
| Next Scan | 2026-03-04T10:55:31+00:00 |
Last Successful Scan
| Scanned | 2025-01-16T06:25:54+00:00 |
| URL | https://meds4gen.com/robots.txt |
| Domain IPs | 35.214.82.55 |
| Response IP | 35.214.82.55 |
| Found | Yes |
| Hash | 4323bdcfd7079dc79f9023a7882aae3d27ba643d42e4f1106f7161fda94c0791 |
| SimHash | 6e01cc63df82 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /wp-admin/ |
| Disallow | /?add_to_wishlist= |
| Disallow | /tag/ |
| Disallow | /product-tag/ |
| Disallow | /?p= |
| Disallow | /feed/ |
| Disallow | /composition/ |
| Disallow | /?attribute_pa_pack-size= |
| Allow | /wp-admin/admin-ajax.php |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 10 |
Other Records
| Field | Value |
|---|---|
| sitemap | https://meds4gen.com/post-sitemap.xml |
| sitemap | https://meds4gen.com/page-sitemap.xml |
| sitemap | https://meds4gen.com/product-sitemap.xml |
| sitemap | https://meds4gen.com/web-story-sitemap.xml |
| sitemap | https://meds4gen.com/category-sitemap.xml |
| sitemap | https://meds4gen.com/product_cat-sitemap.xml |
| sitemap | https://meds4gen.com/html-sitemap/ |