Log In Sign Up

womany.net
robots.txt

Robots Exclusion Standard data for womany.net

Resource Scan

Scan Details

Site Domain womany.net
Base Domain womany.net
Scan Status Ok
Last Scan2024-11-05T01:02:31+00:00
Next Scan 2024-11-12T01:02:31+00:00

Last Scan

Scanned2024-11-05T01:02:31+00:00
URL https://womany.net/robots.txt
Domain IPs 104.19.180.118, 104.19.181.118, 2606:4700::6813:b476, 2606:4700::6813:b576
Response IP 104.19.181.118
Found Yes
Hash 16e0485acfc496c64a78ff62023f81da77d1d878fd95494e66a9236ce37c117c
SimHash 4e0c8454e4d2

Groups

ahrefsbot
semrushbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

yandex
*

Rule Path
Disallow /articles/*/print
Disallow /previews/
Disallow /users/auth/
Disallow /api-cf/
Disallow /search
Back to top

Other Records

Field Value
sitemap https://womany.net/sitemaps.xml
sitemap https://womany.net/sitemaps/articles/sitemap.xml.gz
sitemap https://womany.net/sitemaps/pages/sitemap.xml.gz
sitemap https://womany.net/sitemaps/keywords/sitemap.xml.gz
sitemap https://womany.net/sitemaps/structured/sitemap.xml.gz
sitemap https://womany.net/sitemaps/story/sitemap.xml.gz
Back to top

Warnings

  • `clean-param` is not a known field.
  • `host` is not a known field.
Back to top