moonsault.de
robots.txt

Robots Exclusion Standard data for moonsault.de

Resource Scan

Scan Details

Site Domain moonsault.de
Base Domain moonsault.de
Scan Status Ok
Last Scan2024-10-03T13:31:49+00:00
Next Scan 2024-10-10T13:31:49+00:00

Last Scan

Scanned2024-10-03T13:31:49+00:00
URL https://moonsault.de/robots.txt
Domain IPs 62.113.233.135
Response IP 62.113.233.135
Found Yes
Hash f0f20ceeb6c38a048fec669f753da3f34f52524a376bad24e9865cb30e9200e2
SimHash c21f9170c012

Groups

*

Rule Path
Allow /
Disallow /*?*tagID=
Disallow /*?*action=firstNew
Disallow /*?*action=lastPost
Disallow /user/
Disallow /forum/user-post-list/
Disallow /login/

ahrefsbot
semrushbot
blexbot
dotbot
mj12bot
barkrowler
yandexbot
petalbot
sentibot
dataforseobot
megaindex
neticle
censysinspect
um-ic
researchbot
omgili
bytespider
mojeekbot
seocompany

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.moonsault.de/sitemaps/sitemap.xml

Comments

  • block post links
  • block user profiles
  • list of a user's posts
  • block crawler