creatoom.com
robots.txt

Robots Exclusion Standard data for creatoom.com

Resource Scan

Scan Details

Site Domain creatoom.com
Base Domain creatoom.com
Scan Status Ok
Last Scan2025-12-06T09:11:23+00:00
Next Scan 2026-01-05T09:11:23+00:00

Last Scan

Scanned2025-12-06T09:11:23+00:00
URL https://creatoom.com/robots.txt
Domain IPs 192.124.249.60
Response IP 192.124.249.60
Found Yes
Hash 2164d4d2606a8d3ef8150f65f5cd9d2a6bb180e1adac234c8138463d2b4bcc4e
SimHash 239859418eb5

Groups

*

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 60

yandex

Rule Path
Disallow /cgi-bin/
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php
Disallow /wp-includes/
Disallow /wp-content/plugins/
Disallow /wp-content/themes/
Allow /wp-content/uploads/
Disallow /search/
Disallow /author/
Disallow /users/
Disallow /wishlist/
Disallow */page/
Disallow */trackback
Disallow */feed
Disallow */rss
Disallow */embed
Disallow */wlwmanifest.xml
Disallow /xmlrpc.php
Disallow */?add_to_wishlist*
Disallow *utm*%3D
Disallow *openstat%3D
Allow /*.js
Allow /*.css
Allow /wp-*.png
Allow /wp-*.jpg
Allow /wp-*.jpeg
Allow /wp-*.gif
Allow /*/*.js
Allow /*/*.css
Allow */uploads/

Other Records

Field Value
crawl-delay 5

googlebot

Rule Path
Disallow /cgi-bin/
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php
Disallow /wp-includes/
Disallow /wp-content/plugins/
Disallow /wp-content/themes/
Allow /wp-content/uploads/
Disallow /search/
Disallow /author/
Disallow /users/
Disallow /wishlist/
Disallow */page/
Disallow */trackback
Disallow */feed
Disallow */rss
Disallow */embed
Disallow */wlwmanifest.xml
Disallow /xmlrpc.php
Disallow *utm*%3D
Disallow *openstat%3D
Allow /*.js
Allow /*.css
Allow /wp-*.png
Allow /wp-*.jpg
Allow /wp-*.jpeg
Allow /wp-*.gif
Allow /*/*.js
Allow /*/*.css
Allow */uploads/

grapeshot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

riddler

Rule Path
Disallow /

python-urllib/2.6

Rule Path
Disallow /

disco pump

Rule Path
Disallow /

wget

Rule Path
Disallow /

teleport pro

Rule Path
Disallow /

psbot

Rule Path
Disallow /

twiceler

Rule Path
Disallow /

netinfobot

Rule Path
Disallow /

ubicrawler

Rule Path
Disallow /

doc

Rule Path
Disallow /

zao

Rule Path
Disallow /

sitecheck.internetseer.com

Rule Path
Disallow /

zealbot

Rule Path
Disallow /

msiecrawler

Rule Path
Disallow /

sitesnagger

Rule Path
Disallow /

webstripper

Rule Path
Disallow /

webcopier

Rule Path
Disallow /

fetch

Rule Path
Disallow /

offline explorer

Rule Path
Disallow /

teleport

Rule Path
Disallow /

linko

Rule Path
Disallow /

httrack

Rule Path
Disallow /

microsoft.url.control

Rule Path
Disallow /

xenu

Rule Path
Disallow /

larbin

Rule Path
Disallow /

libwww

Rule Path
Disallow /

zyborg

Rule Path
Disallow /

download ninja

Rule Path
Disallow /

grub-client

Rule Path
Disallow /

npbot

Rule Path
Disallow /

webreaper

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://creatoom.com/sitemap.xml

Comments

  • =============================
  • === Yandex ===
  • =============================
  • Фильтрация URL с мусорными параметрами
  • Разрешаем важные ресурсы
  • =============================
  • === Googlebot ===
  • =============================
  • Clean-param не используется Google через robots.txt (только через Search Console)
  • =============================
  • === Боты, которым запрещён доступ ===
  • =============================
  • =============================
  • === Sitemap и Host ===
  • =============================

Warnings

  • `clean-param` is not a known field.
  • `host` is not a known field.