products.modernatx.com
robots.txt
Robots Exclusion Standard data for products.modernatx.com
Resource Scan
Scan Details
Site Domain | products.modernatx.com |
Base Domain | modernatx.com |
Scan Status | Ok |
Last Scan | 2024-11-03T12:24:56+00:00 |
Next Scan | 2024-12-03T12:24:56+00:00 |
Last Scan
Scanned | 2024-11-03T12:24:56+00:00 |
URL | https://products.modernatx.com/robots.txt |
Domain IPs | 13.225.4.46, 13.225.4.51, 13.225.4.60, 13.225.4.7 |
Response IP | 13.225.4.7 |
Found | Yes |
Hash | cdcde99e33ddd8db357e2003e9c22c0671a1513ccf63644b51221b92bb2d951a |
SimHash | 6904df106818 |
Groups
*
Rule | Path |
---|---|
Disallow | /unsupported-locale |
Disallow | /notFound |
Disallow | /video/ |
Disallow | /500 |
Disallow | /404 |
Disallow | /403 |
Disallow | /*image?url |
Disallow | /*?cid= |
Disallow | /*?rid= |
Disallow | /*assets/fonts/ |
Disallow | /*tc%3Dps |
Disallow | /*?fbclid= |
Disallow | /*node? |
Disallow | /*sites/default/files/ |
Disallow | /*?fromLocale= |
Disallow | /?gclid= |
Disallow | /?ref= |
Disallow | /?fbclid= |
Disallow | /*?utm |
Allow | / |
Other Records
Field | Value |
---|---|
sitemap | https://products.modernatx.com/sitemap.xml |