dosugbarorl.com
robots.txt

Robots Exclusion Standard data for dosugbarorl.com

Resource Scan

Scan Details

Site Domain dosugbarorl.com
Base Domain dosugbarorl.com
Scan Status Ok
Last Scan2024-09-03T10:07:03+00:00
Next Scan 2024-10-03T10:07:03+00:00

Last Scan

Scanned2024-09-03T10:07:03+00:00
URL https://dosugbarorl.com/robots.txt
Domain IPs 190.115.31.222
Response IP 190.115.31.222
Found Yes
Hash 86d76acb0ea6cca8ff364618bdea3166943257ca6da2394c98413e7de93792a5
SimHash 0b6b1c4a0473

Groups

*

Rule Path
Disallow /backup
Disallow /includes
Disallow /cron
Disallow /tmp
Disallow /print*
Disallow /*?sort_by=
Disallow /*%26sort_by%3D
Disallow /*?sort_type=
Disallow /*%26sort_type%3D
Disallow /%5Bgeo_url%5D*

yandex

Rule Path
Disallow /backup
Disallow /includes
Disallow /cron
Disallow /tmp
Disallow /print*
Disallow /*?sort_by=
Disallow /*%26sort_by%3D
Disallow /*?sort_type=
Disallow /*%26sort_type%3D
Disallow /%5Bgeo_url%5D*

alexabot

Rule Path
Disallow /

ia_archiver

Rule Path
Disallow /

semrushbot
semrushbot-sa
mj12bot
dotbot
rogerbot
megaindex.ru
megaindex.com
megaindex.ru/2.0
alexibot
surveybot
backlinkcrawler
sistrix crawler
sistrix
sistrix
uptimerobot/2.0

Product Comment
semrushbot Semrush
semrushbot-sa Semrush technical
mj12bot Majestic
dotbot Moz
rogerbot Moz
megaindex.ru https://megaindex.com/crawler
megaindex.com https://megaindex.com/crawler
megaindex.ru/2.0 MegaIndex.ru
alexibot Alexa
surveybot Surveybot.io
backlinkcrawler http://www.backlinktest.com
sistrix crawler Block SISTRIX
sistrix Block SISTRIX
sistrix Block SISTRIX
uptimerobot/2.0 Block Uptime robot
Rule Path
Disallow /
Disallow /*confirm.html*
Disallow /*listing-details.html*
Disallow /*print.html*
Disallow /404.html*
Disallow /*listing-remove.html*
Disallow /*newsletter.html*
Disallow /*excel-import-export.html*
Disallow /*booking-order.html*

Other Records

Field Value
sitemap https://dosugbarorl.com/sitemap.xml

Comments

  • robots.txt
  • Rules generated by the Sitemap plugin
  • Excluded pages:

Warnings

  • `host` is not a known field.