Log In Sign Up

generator.ua
robots.txt

Robots Exclusion Standard data for generator.ua

Resource Scan

Scan Details

Site Domain generator.ua
Base Domain generator.ua
Scan Status Ok
Last Scan2024-06-07T02:53:49+00:00
Next Scan 2024-07-07T02:53:49+00:00

Last Scan

Scanned2024-06-07T02:53:49+00:00
URL https://generator.ua/robots.txt
Domain IPs 135.181.107.226
Response IP 135.181.107.226
Found Yes
Hash 8bc4ff1cb52add4f571e251c7130c6530b869ac477e05acbadc94511dce31374
SimHash 457cb03d069b

Groups

mj12bot
bingbot
dotbot
yandeximages
uptimerobot
yandexmetrika
yandexmobilebot
yandexbot
yandeximageresizer
mail.ru_bot
mail.ru_bot/img
mail.ru_bot/fast
blexbot

Rule Path
Disallow /

*

Rule Path
Allow */modules/*.css
Allow */modules/*.js
Allow */modules/*.jpg
Allow */modules/*.gif
Allow */modules/*.png
Allow */modules/*.avi
Allow */themes/*.css
Allow */themes/*.js
Allow */themes/*.jpg
Allow */themes/*.gif
Allow */themes/*.png
Allow */themes/*.avi
Allow */themes/*/fonts/*
Allow /*?p=*
Disallow /*orderby%3D
Disallow /*orderway%3D
Disallow /*tag%3D
Disallow /*id_currency%3D
Disallow /*back%3D
Disallow /*n%3D
Disallow /*controller%3Daddresses
Disallow /*controller%3Daddress
Disallow /*controller%3Dauthentication
Disallow /*controller%3Dcart
Disallow /*controller%3Ddiscount
Disallow /*controller%3Dfooter
Disallow /*controller%3Dget-file
Disallow /*controller%3Dheader
Disallow /*controller%3Dhistory
Disallow /*controller%3Didentity
Disallow /*controller%3Dimages.inc
Disallow /*controller%3Dinit
Disallow /*controller%3Dmy-account
Disallow /*controller%3Dorder
Disallow /*controller%3Dorder-opc
Disallow /*controller%3Dorder-slip
Disallow /*controller%3Dorder-detail
Disallow /*controller%3Dorder-follow
Disallow /*controller%3Dorder-return
Disallow /*controller%3Dorder-confirmation
Disallow /*controller%3Dpagination
Disallow /*controller%3Dpassword
Disallow /*controller%3Dpdf-invoice
Disallow /*controller%3Dpdf-order-return
Disallow /*controller%3Dpdf-order-slip
Disallow /*controller%3Dproduct-sort
Disallow /*controller%3Dsearch
Disallow /*controller%3Dstatistics
Disallow /*controller%3Dattachment
Disallow /*controller%3Dguest-tracking
Disallow */classes/
Disallow */config/
Disallow */download/
Disallow */mails/
Disallow */modules/
Disallow */translations/
Disallow */tools/
Disallow */address
Disallow */addresses
Disallow */authentication
Disallow */cart
Disallow */discount
Disallow */guest-tracking
Disallow */order-history
Disallow */identity
Disallow */my-account
Disallow */order
Disallow */order-follow
Disallow */quick-order
Disallow */order-slip
Disallow */password-recovery
Disallow */search
Disallow */akcionnyj-tovar/*
Disallow /priceup
Disallow /priceup/
Disallow /priceup/*
Disallow /generatortest
Disallow /generatortest/
Disallow /generatortest/*
Disallow /generatortest2
Disallow /generatortest2/
Disallow /generatortest2/*

Other Records

Field Value
crawl-delay 10
Back to top

Other Records

Field Value
sitemap https://generator.ua/1_index_sitemap.xml
sitemap https://generator.ua/ru/as4_seositemap-1.xml
sitemap https://generator.ua/ru/as4_seositemap-2.xml
Back to top

Comments

  • Allow Directives
  • Private pages
  • Disallow: /*search_query=
  • Directories
  • Files
  • Price UP
Back to top

Warnings

  • `host` is not a known field.
Back to top