dwworld.org
robots.txt

Robots Exclusion Standard data for dwworld.org

Resource Scan

Scan Details

Site Domain dwworld.org
Base Domain dwworld.org
Scan Status Ok
Last Scan2024-07-01T19:55:58+00:00
Next Scan 2024-07-08T19:55:58+00:00

Last Scan

Scanned2024-07-01T19:55:58+00:00
URL https://www.dwworld.org/robots.txt
Domain IPs 20.224.123.88
Response IP 20.224.123.88
Found Yes
Hash 583ba7e5e5770c2ece50e90b81bd62c7e29ae5dfb92e764c53b35b4b0e227a6b
SimHash d388c942c1b1

Groups

*

Rule Path
Disallow /search/
Disallow /overlay/
Disallow /popups/mediaplayer/
Disallow /popups/popup_gallery/
Disallow /*/layoutvorlagen/
Disallow /*/user/account$
Disallow /*/user/activity$
Disallow /*/user/profile$
Disallow /*/user/password/change$
Disallow /*/user/password/set$
Disallow /*/user/feedback/status?type=*
Disallow /*/user/register/confirm$
Disallow /*/user/email/change$
Disallow /*?maca=*

twitterbot

Rule Path
Allow /*?maca=*

Other Records

Field Value
sitemap https://www.dwworld.org/sitemap.xml