Log In Sign Up

all-for-woman.com
robots.txt

Robots Exclusion Standard data for all-for-woman.com

Resource Scan

Scan Details

Site Domain all-for-woman.com
Base Domain all-for-woman.com
Scan Status Ok
Last Scan2024-06-14T11:56:16+00:00
Next Scan 2024-06-21T11:56:16+00:00

Last Scan

Scanned2024-06-14T11:56:16+00:00
URL https://all-for-woman.com/robots.txt
Response IP 38.180.38.243
Found Yes
Hash abd648374b3e87646dcb36940b8cd2e19252a1b1d3d2d378f84ccf599c0876a2
SimHash 0bc9dc635381

Groups

*

Rule Path
Allow /
Disallow /best/*
Disallow /service/*
Disallow /settings/*
Disallow /landing/*
Disallow /comments/**
Disallow /registration/*
Disallow /login/*
Disallow */page*/
Disallow /talk/*

semrushbot

Rule Path
Disallow /

semrushbot-sa

Rule Path
Disallow /

yandexdirect

Rule Path
Allow /
Disallow

yandex

Rule Path
Disallow /best/*
Disallow /service/*
Disallow /settings/*
Disallow /landing/*
Disallow /comments/**
Disallow /registration/*
Disallow /login/*
Disallow */page*/
Disallow /talk/*
Disallow *.amp
Back to top

Other Records

Field Value
sitemap https://all-for-woman.com/sitemap.xml
Back to top

Warnings

  • `clean-param` is not a known field.
  • `host` is not a known field.
Back to top