paulayoung.com
robots.txt
Robots Exclusion Standard data for paulayoung.com
Resource Scan
Scan Details
Site Domain | paulayoung.com |
Base Domain | paulayoung.com |
Scan Status | Ok |
Last Scan | 2025-08-29T01:16:06+00:00 |
Next Scan | 2025-09-28T01:16:06+00:00 |
Last Scan
Scanned | 2025-08-29T01:16:06+00:00 |
URL | https://paulayoung.com/robots.txt |
Redirect | https://www.paulayoung.com:443/robots.txt |
Redirect Domain | www.paulayoung.com |
Redirect Base | paulayoung.com |
Domain IPs | 216.137.52.103, 216.137.52.5, 216.137.52.86, 216.137.52.97 |
Redirect IPs | 108.157.194.22, 108.157.194.52, 108.157.194.72, 108.157.194.84 |
Response IP | 18.244.87.98 |
Found | Yes |
Hash | 29a16d3c1124ac3d97815c983b4c7d98eaa6049df7338f7e789de08ab3443b6c |
SimHash | e9402d061492 |
Groups
*
Rule | Path |
---|---|
Disallow | /*? |
Disallow | /*.aspx$ |
Disallow | /checkout-page |
Disallow | /confirmation-page |
Disallow | /content/ |
Disallow | /episerver? |
Disallow | /forgot-your-password-page |
Disallow | /login-page |
Disallow | /return-label-page |
Disallow | /reset-password-page |
Disallow | /search-page |
Disallow | /shopping-cart-page |
Disallow | /track-order-page |
Disallow | /track-order-login-page |
Disallow | /email-signup-thank-you |
Disallow | /account-page/ |
Disallow | /Scripts/ |
Disallow | /api/ |
Disallow | /fpc/ |
Allow | /bundles |
Allow | /styles |
Allow | /*?*sourcecode= |
Other Records
Field | Value |
---|---|
sitemap | https://www.paulayoung.com/sitemap.xml |
Comments