dazeddigital.com
robots.txt

Robots Exclusion Standard data for dazeddigital.com

Resource Scan

Scan Details

Site Domain dazeddigital.com
Base Domain dazeddigital.com
Scan Status Ok
Last Scan2025-03-13T00:31:03+00:00
Next Scan 2025-03-20T00:31:03+00:00

Last Scan

Scanned2025-03-13T00:31:03+00:00
URL https://dazeddigital.com/robots.txt
Redirect https://www.dazeddigital.com/robots.txt
Redirect Domain www.dazeddigital.com
Redirect Base dazeddigital.com
Domain IPs 13.69.228.44
Redirect IPs 2600:1413:b000:6::17d5:2bd0, 2600:1413:b000:6::17d5:2bd5, 96.17.96.11, 96.17.96.14
Response IP 96.17.96.14
Found Yes
Hash 74b20351535e1cae9392b2477e824fed8aef6c1dca64de823623d8e26bf5f333
SimHash 58145164e950

Groups

*

Rule Path
Disallow /search/*
Disallow /admin/
Disallow /account/
Disallow /Subscriber/CreateWidget
Disallow /beauty/politics/*
Disallow /beauty/life-culture/*
Disallow /beauty/science-tech/*
Disallow /beauty/film-tv/*
Disallow /beauty/art-photography/*
Disallow /beauty/music/*
Disallow /beauty/fashion/*
Disallow /body/*
Disallow /soul/*
Disallow /head/*
Disallow /community/*
Disallow /masculinity/*
Disallow /article/ListJson*
Disallow /article/ArticleListJson*
Disallow /article/listjson*
Disallow /article/articlelistjson*
Disallow /Article/ListJson*
Disallow /Article/ArticleListJson*
Disallow /beauty/article/ListJson*
Disallow /beauty/article/ArticleListJson*
Disallow /beauty/Article/ListJson*
Disallow /beauty/Article/ArticleListJson*

gptbot

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

chatgpt-user

Rule Path
Disallow /

Comments

  • allowRobotsTxtUrl: https://www.dazeddigital.com/robots.txt
  • url: https://www.dazeddigital.com/robots.txt