allergija.com
robots.txt

Robots Exclusion Standard data for allergija.com

Resource Scan

Scan Details

Site Domain allergija.com
Base Domain allergija.com
Scan Status Ok
Last Scan2026-01-13T13:32:29+00:00
Next Scan 2026-01-20T13:32:29+00:00

Last Scan

Scanned2026-01-13T13:32:29+00:00
URL https://allergija.com/robots.txt
Domain IPs 87.236.16.201
Response IP 87.236.16.201
Found Yes
Hash e57e9fb68f57aa98443cb18f913161826f4dd9ca1b593924018074698c0341b4
SimHash 6908ebf2cab9

Groups

*

Rule Path
Disallow /wp-login.php
Disallow /wp-register.php
Disallow /cgi-bin/
Disallow /wp-admin/
Disallow /wp-includes/
Disallow /wp-content/
Disallow /spektr/
Disallow /trackback
Disallow */trackback
Disallow */*/trackback
Disallow */*/feed
Disallow */feed
Disallow /*?*
Disallow /tag
Disallow /category/
Disallow /author/
Disallow /20*/*
Disallow /page/*
Allow */uploads
Allow /*/*.js
Allow /*/*.css
Allow /wp-*.png
Allow /wp-*.jpg
Allow /wp-*.jpeg
Allow /wp-*.gif

Other Records

Field Value
crawl-delay 30

googlebot-image

Rule Path
Allow /wp-content/uploads/

yandeximages

Rule Path
Allow /wp-content/uploads/

yandex

Rule Path
Disallow /wp-login.php
Disallow /wp-register.php
Disallow /cgi-bin/
Disallow /wp-admin/
Disallow /wp-includes/
Disallow /wp-content/
Disallow /spektr/
Allow /wp-content/uploads
Disallow /trackback
Disallow */trackback
Disallow */*/trackback
Disallow */*/feed
Disallow */feed
Disallow /*?*
Disallow /tag
Disallow /category/
Disallow /author/
Disallow /20*/*
Disallow /page/*

Other Records

Field Value
sitemap https://allergija.com/sitemap.xml
sitemap https://allergija.com/sitemap.xml.gz

Warnings

  • `host` is not a known field.