mandsyourschooluniform.com
robots.txt

Robots Exclusion Standard data for mandsyourschooluniform.com

Resource Scan

Scan Details

Site Domain mandsyourschooluniform.com
Base Domain mandsyourschooluniform.com
Scan Status Ok
Last Scan2024-10-13T05:48:57+00:00
Next Scan 2024-11-12T05:48:57+00:00

Last Scan

Scanned2024-10-13T05:48:57+00:00
URL https://www.mandsyourschooluniform.com/robots.txt
Domain IPs 13.107.246.59, 2620:1ec:bdf::59
Response IP 13.107.246.70
Found Yes
Hash c118b6d9ccccc2b64c6c374f191bc62f8401d7b6df327b4f0d23abd3af670ebd
SimHash 090d0c1b43a3

Groups

*

Rule Path
Disallow /signin
Disallow /cart
Disallow /*refiners%3D
Disallow /*sorting%3D
Disallow /*search?
Disallow /*search%3D
Disallow /*.woff
Disallow /*.woff2

Other Records

Field Value
crawl-delay 10

*

Rule Path
Disallow /src/resources/
Disallow /search/
Disallow /thankyou/
Disallow /signin/
Disallow /signup/
Disallow /password-reset/
Disallow /password-reset-verification/
Disallow /profile-edit/
Disallow /cart/
Disallow /checkout/
Disallow /*refiners*

Other Records

Field Value
sitemap https://www.mandsyourschooluniform.com/_msdyn365/sitemap/MD1BVE
sitemap https://www.mandsyourschooluniform.com/_msdyn365/sitemap/MD1BVG

Comments

  • This instructs for all search engnes not to crawl below subdirectories and pages.
  • Sitemap URLs