takewm.online
robots.txt

Robots Exclusion Standard data for takewm.online

Resource Scan

Scan Details

Site Domain takewm.online
Base Domain takewm.online
Scan Status Ok
Last Scan2024-10-03T08:24:59+00:00
Next Scan 2024-10-10T08:24:59+00:00

Last Scan

Scanned2024-10-03T08:24:59+00:00
URL https://takewm.online/robots.txt
Domain IPs 80.85.141.39
Response IP 80.85.141.39
Found Yes
Hash 0be7144b2b4fb1469681d4d213940f56f17c76ca5db85b4e81cb1ac8a63a34f2
SimHash 5909a850f431

Groups

*

Rule Path
Allow /*.js
Allow /*.css
Allow /engine/classes/js/
Allow /engine/classes/min/index.php
Allow /engine/data/emoticons/
Disallow /engine/go.php
Disallow /engine/download.php
Disallow /user/
Disallow /newposts/
Disallow /statistics.html
Disallow /*subaction%3Duserinfo
Disallow /*subaction%3Dnewposts
Disallow /*do%3Dlastcomments
Disallow /*do%3Dfeedback
Disallow /*do%3Dregister
Disallow /*do%3Dlostpassword
Disallow /*do%3Daddnews
Disallow /*do%3Dstats
Disallow /*do%3Dpm
Disallow /*do%3Dsearch
Disallow /engine/*
Disallow */page/*/
Disallow */page/
Disallow /user/*
Disallow /lastnews/*
Disallow /catalog/*
Disallow /newposts/*
Disallow /favorites/
Disallow /rules.html
Disallow /statistics.html
Disallow /index.php?do=*
Disallow /*rss.xml
Disallow /addnews.html
Disallow /favorites/

yandex

Rule Path
Allow /*.js
Allow /*.css
Allow /engine/classes/js/
Allow /engine/classes/min/index.php
Allow /engine/data/emoticons/
Disallow /engine/*
Disallow */page/*/
Disallow */page/
Disallow /user/*
Disallow /engine/go.php
Disallow /engine/download.php
Disallow /user/
Disallow /newposts/
Disallow /statistics.html
Disallow /*subaction%3Duserinfo
Disallow /*subaction%3Dnewposts
Disallow /*do%3Dlastcomments
Disallow /*do%3Dfeedback
Disallow /*do%3Dregister
Disallow /*do%3Dlostpassword
Disallow /*do%3Daddnews
Disallow /*do%3Dstats
Disallow /*do%3Dpm
Disallow /*do%3Dsearch
Disallow /lastnews/*
Disallow /catalog/*
Disallow /newposts/*
Disallow /favorites/
Disallow /rules.html
Disallow /statistics.html
Disallow /index.php?do=*
Disallow /*rss.xml
Disallow /addnews.html
Disallow /favorites/

googlebot

Rule Path
Allow /*.js
Allow /*.css
Allow /engine/classes/js/
Allow /engine/classes/min/index.php
Allow /engine/data/emoticons/
Disallow /engine/*
Disallow /engine/go.php
Disallow /engine/download.php
Disallow /user/
Disallow /newposts/
Disallow /statistics.html
Disallow /*subaction%3Duserinfo
Disallow /*subaction%3Dnewposts
Disallow /*do%3Dlastcomments
Disallow /*do%3Dfeedback
Disallow /*do%3Dregister
Disallow /*do%3Dlostpassword
Disallow /*do%3Daddnews
Disallow /*do%3Dstats
Disallow /*do%3Dpm
Disallow /*do%3Dsearch
Disallow */page/*/
Disallow */page/
Disallow /user/*
Disallow /lastnews/*
Disallow /catalog/*
Disallow /newposts/*
Disallow /favorites/
Disallow /rules.html
Disallow /statistics.html
Disallow /index.php?do=*
Disallow /*rss.xml
Disallow /addnews.html
Disallow /favorites/

Other Records

Field Value
sitemap https://takewm.online/sitemap.xml

Warnings

  • `host` is not a known field.