roman.ua
robots.txt

Robots Exclusion Standard data for roman.ua

Resource Scan

Scan Details

Site Domain roman.ua
Base Domain roman.ua
Scan Status Ok
Last Scan5/12/2025, 4:10:52 AM
Next Scan 6/11/2025, 4:10:52 AM

Last Scan

Scanned5/12/2025, 4:10:52 AM
URL https://roman.ua/robots.txt
Domain IPs 104.21.77.92, 172.67.206.114, 2606:4700:3031::6815:4d5c, 2606:4700:3032::ac43:ce72
Response IP 104.21.77.92
Found Yes
Hash d99af5a35508578ade1763b10b395c54f877337ae984cbd4a74515da357353c2
SimHash 02509d62e260

Groups

*

Rule Path
Disallow /uk/*
Disallow /en/category/internet-marketing/*
Disallow /en/category/articles/*
Disallow /cgi-bin
Disallow /wp-admin
Disallow /wp-login.php
Disallow /wp-content/cache
Allow /wp-content/cache/autoptimize/
Allow /wp-content/uploads
Disallow /wp-content/uploads/2016/07/*.pdf
Disallow /wp-trackback
Disallow /wp-feed
Disallow /wp-comments
Disallow */comments
Disallow */trackback
Disallow */feed
Disallow /*?*
Disallow /*?
Disallow /scripts
Disallow /category/dm/page/*
Disallow /category/seo/page/*
Disallow /category/analytics/page/*
Disallow /category/smm/page/*
Disallow /category/prezentacii/page/*
Disallow /category/kontekstnaya-reklama/page/*
Disallow /category/best/
Disallow /category/video/
Disallow /category/vystupleniya/
Disallow /category/stati/
Disallow /category/rekomendacii/
Disallow /category/internet-marketing/
Disallow /wp-json/
Allow /*?ver=*
Allow /*.js
Allow /*.css
Allow /*.jpg
Allow /*.gif
Allow /*.png
Allow /*.svg
Allow /*.ttf
Allow /*.woff

seokicks-robot

Rule Path
Disallow /

seekportbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 3600

ahrefsbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 3600

loluabot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 3600

Warnings

  • `host` is not a known field.