dexeryl.com
robots.txt
Robots Exclusion Standard data for dexeryl.com
Resource Scan
Scan Details
Site Domain | dexeryl.com |
Base Domain | dexeryl.com |
Scan Status | Ok |
Last Scan | 2025-05-23T00:07:46+00:00 |
Next Scan | 2025-06-22T00:07:46+00:00 |
Last Scan
Scanned | 2025-05-23T00:07:46+00:00 |
URL | https://dexeryl.com/robots.txt |
Redirect | https://www.dexeryl.com/robots.txt |
Redirect Domain | www.dexeryl.com |
Redirect Base | dexeryl.com |
Domain IPs | 13.51.62.86 |
Redirect IPs | 151.101.130.216, 151.101.194.216, 151.101.2.216, 151.101.66.216 |
Response IP | 151.101.2.216 |
Found | Yes |
Hash | e346fd65b45a78918154f8776fb8a6e6ed81a9adcddab1ea585fde8742a070ee |
SimHash | 900158068930 |
Groups
*
Rule | Path |
---|---|
Disallow | /admin |
Disallow | /specials |
Disallow | */view/content/* |
Disallow | */reviews_by_offset/* |
Disallow | */client_country/* |
Disallow | /SM/Unsupported |
Disallow | /Classic |
Disallow | /Unavailable |
Disallow | /Module |
Disallow | /called |
Disallow | */api/plp/products* |
Other Records
Field | Value |
---|---|
sitemap | https://www.dexeryl.com/sitemap.xml |