a.dosugbarufa.com
robots.txt

Robots Exclusion Standard data for a.dosugbarufa.com

Resource Scan

Scan Details

Site Domain a.dosugbarufa.com
Base Domain dosugbarufa.com
Scan Status Ok
Last Scan2024-09-08T18:09:11+00:00
Next Scan 2024-10-08T18:09:11+00:00

Last Scan

Scanned2024-09-08T18:09:11+00:00
URL https://a.dosugbarufa.com/robots.txt
Domain IPs 5.61.52.149
Response IP 5.61.52.149
Found Yes
Hash 1f543da86340fc81bb26fac43c958797ad0c599f06c617fae3a7c85c894eafbb
SimHash 0b6b3c4a1452

Groups

*

Rule Path
Disallow /backup
Disallow /includes
Disallow /cron
Disallow /tmp
Disallow /print*
Disallow /*?sort_by=
Disallow /*%26sort_by%3D
Disallow /*?sort_type=
Disallow /*%26sort_type%3D
Disallow /%5Bgeo_url%5D*

yandex

Rule Path
Disallow /backup
Disallow /includes
Disallow /cron
Disallow /tmp
Disallow /print*
Disallow /*?sort_by=
Disallow /*%26sort_by%3D
Disallow /*?sort_type=
Disallow /*%26sort_type%3D
Disallow /%5Bgeo_url%5D*

alexabot

Rule Path
Disallow /

ia_archiver

Rule Path
Disallow /

semrushbot
semrushbot-sa
mj12bot
dotbot
rogerbot
megaindex.ru
megaindex.com
megaindex.ru/2.0
alexibot
surveybot
backlinkcrawler
sistrix crawler
sistrix
sistrix
uptimerobot/2.0

Product Comment
semrushbot Semrush
semrushbot-sa Semrush technical
mj12bot Majestic
dotbot Moz
rogerbot Moz
megaindex.ru https://megaindex.com/crawler
megaindex.com https://megaindex.com/crawler
megaindex.ru/2.0 MegaIndex.ru
alexibot Alexa
surveybot Surveybot.io
backlinkcrawler http://www.backlinktest.com
sistrix crawler Block SISTRIX
sistrix Block SISTRIX
sistrix Block SISTRIX
uptimerobot/2.0 Block Uptime robot
Rule Path
Disallow /
Disallow /*confirm.html*
Disallow /*listing-details.html*
Disallow /*print.html*
Disallow /404.html*
Disallow /*listing-remove.html*
Disallow /*newsletter.html*
Disallow /*excel-import-export.html*
Disallow /*booking-order.html*

Other Records

Field Value
sitemap https://dosugbarufa.com/sitemap.xml

Comments

  • robots.txt
  • Rules generated by the Sitemap plugin
  • Excluded pages:

Warnings

  • `host` is not a known field.