muabanraovat.com
robots.txt

Robots Exclusion Standard data for muabanraovat.com

Resource Scan

Scan Details

Site Domain muabanraovat.com
Base Domain muabanraovat.com
Scan Status Ok
Last Scan2024-09-29T23:01:42+00:00
Next Scan 2024-10-29T23:01:42+00:00

Last Scan

Scanned2024-09-29T23:01:42+00:00
URL http://muabanraovat.com/robots.txt
Domain IPs 27.0.12.12
Response IP 27.0.12.12
Found Yes
Hash fc3a7e13fe6fa0d788751f39d1bf4051356d27683671c962064dccac8237f14d
SimHash 465ed860d3d7

Groups

mj12bot

Rule Path
Disallow /

exabot

Rule Path
Disallow /

yodaobot

Rule Path
Disallow /

yandex

Rule Path
Disallow /

ezooms

Rule Path
Disallow /

linkscrawler

Rule Path
Disallow /

compspybot

Rule Path
Disallow /

jikespider

Rule Path
Disallow /

mail.ru_bot

Rule Path
Disallow /

seznambot

Rule Path
Disallow /

discoverybot

Rule Path
Disallow /

turnitinbot

Rule Path
Disallow /

riddler

Rule Path
Disallow /

rubrikkbot

Rule Path
Disallow /

grapeshotcrawler

Rule Path
Disallow /

yandexbot

Rule Path
Disallow /

*

Rule Path
Disallow /template/
Disallow /templates/
Disallow /templates_c/
Disallow /captcha/
Disallow /configs/
Disallow /ckeditor/
Disallow /fckeditor/
Disallow /ajaxtabscontent/
Disallow /dang-nhap.html
Disallow /dang-nhap-sai-email-hay-mat-khau.html
Disallow /thanh-vien-chua-kich-hoat.html
Disallow /thanh-vien-bi-khoa.html
Disallow /dang-nhap-xay-ra-loi.html
Disallow /dang-nhap-khong-hop-le.html
Disallow /captcha.html
Disallow /khong-tim-thay-thong-tin-nay.html
Disallow /thong-bao-ban-tin-xau-*.html
Disallow /thong-bao-ban-tin-xau.html
Disallow /trang-tin-*.html
Disallow /lien-he-voi-nguoi-dang-*.html
Disallow /mua-ban/?from=*
Disallow /main.php?cat_id=*
Disallow /mua-ban/?cat_id=*
Disallow /mua-ban/?cat_id=*&where_id=*
Disallow /main.php

Other Records

Field Value
crawl-delay 10

Other Records

Field Value
sitemap http://muabanraovat.com/sitemap.xml

Warnings

  • 2 invalid lines.