distonija.com
robots.txt

Robots Exclusion Standard data for distonija.com

Resource Scan

Scan Details

Site Domain distonija.com
Base Domain distonija.com
Scan Status Ok
Last Scan2024-09-30T02:28:02+00:00
Next Scan 2024-10-07T02:28:02+00:00

Last Scan

Scanned2024-09-30T02:28:02+00:00
URL https://distonija.com/robots.txt
Domain IPs 45.130.41.184
Response IP 45.130.41.184
Found Yes
Hash cfc94f718c3cb8a3b04aa135874cd4f8c6872d4f1ce6257d3fbd9c118fb44ed7
SimHash 6b08ebe2cabd

Groups

*

Rule Path
Disallow /wp-login.php
Disallow /wp-register.php
Disallow /cgi-bin/
Disallow /wp-admin/
Disallow /wp-includes/
Disallow /wp-content/
Disallow /spektr/
Disallow /trackback
Disallow */trackback
Disallow */*/trackback
Disallow */*/feed
Disallow */feed
Disallow /*?*
Disallow /tag
Disallow /category/
Disallow /author/
Disallow /20*/*
Disallow /page/*
Allow */uploads
Allow /*/*.js
Allow /*/*.css
Allow /wp-*.png
Allow /wp-*.jpg
Allow /wp-*.jpeg
Allow /wp-*.gif

Other Records

Field Value
crawl-delay 30

googlebot-image

Rule Path
Allow /wp-content/uploads/

yandeximages

Rule Path
Allow /wp-content/uploads/

yandex

Rule Path
Disallow /wp-login.php
Disallow /wp-register.php
Disallow /cgi-bin/
Disallow /wp-admin/
Disallow /wp-includes/
Disallow /wp-content/
Disallow /spektr/
Allow /wp-content/uploads
Disallow /trackback
Disallow */trackback
Disallow */*/trackback
Disallow */*/feed
Disallow */feed
Disallow /*?*
Disallow /tag
Disallow /category/
Disallow /author/
Disallow /20*/*
Disallow /page/*

Other Records

Field Value
sitemap https://distonija.com/sitemap.xml
sitemap https://distonija.com/sitemap.xml.gz

Warnings

  • `host` is not a known field.