shophelper.ad9g.com
robots.txt
Robots Exclusion Standard data for shophelper.ad9g.com
Resource Scan
Scan Details
| Site Domain | shophelper.ad9g.com |
| Base Domain | ad9g.com |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Server returned a client error. |
| Last Scan | 2024-09-07T08:57:59+00:00 |
| Next Scan | 2024-11-06T08:57:59+00:00 |
Last Successful Scan
| Scanned | 2024-07-10T08:56:54+00:00 |
| URL | https://shophelper.ad9g.com/robots.txt |
| Domain IPs | 104.21.72.232, 172.67.155.171, 2606:4700:3031::6815:48e8, 2606:4700:3031::ac43:9bab |
| Response IP | 104.21.72.232 |
| Found | Yes |
| Hash | bd074415ec6383320d414196e891cf4b243b6ab33637d249af51a16af41e3264 |
| SimHash | 001ccb6e8e33 |
Groups
*
| Rule | Path |
|---|---|
| Allow | / |
| Disallow | *r.php* |
| Disallow | */page/search/* |
| Disallow | */page/?p* |
| Disallow | */form/* |
| Disallow | */page/?p* |
| Disallow | */offers/* |
Other Records
| Field | Value |
|---|---|
| sitemap | https://shophelper.ad9g.com/s/k/category.txt |
| sitemap | https://shophelper.ad9g.com/sitemap_index.xml |
| sitemap | https://shophelper.ad9g.com/s/k/pages.xml |
| sitemap | https://shophelper.ad9g.com/s/k/pages_0.txt |
| sitemap | https://shophelper.ad9g.com/s/m/cadd/0.txt |
| sitemap | https://shophelper.ad9g.com/s/m/cadc/0.txt |
| sitemap | https://shophelper.ad9g.com/s/k/cat_tag.txt |
| sitemap | https://shophelper.ad9g.com/s/k/cat_brand.txt |
| sitemap | https://shophelper.ad9g.com/s/k/cat_categories.txt |