rawlplug.com
robots.txt
Robots Exclusion Standard data for rawlplug.com
Resource Scan
Scan Details
Site Domain | rawlplug.com |
Base Domain | rawlplug.com |
Scan Status | Ok |
Last Scan | 2024-09-15T14:19:54+00:00 |
Next Scan | 2024-10-15T14:19:54+00:00 |
Last Scan
Scanned | 2024-09-15T14:19:54+00:00 |
URL | https://rawlplug.com/robots.txt |
Domain IPs | 13.107.246.58 |
Response IP | 13.107.246.59 |
Found | Yes |
Hash | 8f7cec5df0c2f11acd0198517a47b3bb09429a1e5e63e4948f6332bf69b95112 |
SimHash | cd27c620bcb1 |
Groups
*
Rule | Path |
---|---|
Allow | /headless/global/en/sitemap.xml |
Allow | /headless/pl/pl/sitemap.xml |
Disallow | /*/account |
Disallow | /*/checkout |
Disallow | /*/customer |
Disallow | /graphql/ |
Disallow | /rest/ |
Disallow | /headless/ |
Other Records
Field | Value |
---|---|
sitemap | https://rawlplug.com/headless/global/en/sitemap.xml |
sitemap | https://rawlplug.com/media/sitemap_global.xml |
sitemap | https://rawlplug.com/headless/pl/pl/sitemap.xml |
sitemap | https://rawlplug.com/media/sitemap.xml |
Comments