lelongtips.com.my
robots.txt

Robots Exclusion Standard data for lelongtips.com.my

Resource Scan

Scan Details

Site Domain lelongtips.com.my
Base Domain lelongtips.com.my
Scan Status Ok
Last Scan3/12/2025, 4:29:09 AM
Next Scan 3/19/2025, 4:29:09 AM

Last Scan

Scanned3/12/2025, 4:29:09 AM
URL https://lelongtips.com.my/robots.txt
Redirect https://www.lelongtips.com.my/robots.txt
Redirect Domain www.lelongtips.com.my
Redirect Base lelongtips.com.my
Domain IPs 52.77.93.123
Redirect IPs 52.77.93.123
Response IP 52.77.93.123
Found Yes
Hash f5d43aeca0aeb17e5a13451634e4ef7ad1cf0e0853d5f198a0c2d5a8dca46d06
SimHash 60d37103ce60

Groups

googlebot

Rule Path
Allow /$
Allow /search
Allow /news-articles
Allow /buy-auction
Allow /blogs
Allow /tools
Allow /about-us
Allow /advertise-with-us
Allow /sitemap
Allow /auto
Allow /property
Allow /ads.txt
Disallow /

mediapartners-google

Rule Path
Allow /$
Allow /search
Allow /news-articles
Allow /buy-auction
Allow /blogs
Allow /tools
Allow /about-us
Allow /advertise-with-us
Allow /sitemap
Allow /auto
Allow /property
Disallow /

googlebot-image

Rule Path
Allow /$
Allow /search
Allow /news-articles
Allow /buy-auction
Allow /blogs
Allow /tools
Allow /about-us
Allow /advertise-with-us
Allow /sitemap
Allow /auto
Allow /property
Disallow /

adsbot-google

Rule Path
Allow /$
Allow /search
Allow /news-articles
Allow /buy-auction
Allow /blogs
Allow /tools
Allow /about-us
Allow /advertise-with-us
Allow /sitemap
Allow /auto
Allow /property
Disallow /

slurp

Rule Path
Allow /$
Allow /search
Allow /news-articles
Allow /buy-auction
Allow /blogs
Allow /tools
Allow /about-us
Allow /advertise-with-us
Allow /sitemap
Allow /auto
Allow /property
Disallow /

Other Records

Field Value
crawl-delay 1

msnbot

Rule Path
Allow /$
Allow /search
Allow /news-articles
Allow /buy-auction
Allow /blogs
Allow /tools
Allow /about-us
Allow /advertise-with-us
Allow /sitemap
Allow /auto
Allow /property
Disallow /

Other Records

Field Value
crawl-delay 10

trovitbot

Rule Path
Disallow /

bingbot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

bloglines/3.1

Rule Path
Disallow /

bubing

Rule Path
Disallow /

cityreview

Rule Path
Disallow /

doc

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

download ninja

Rule Path
Disallow /

exabot

Rule Path
Disallow /

fetch

Rule Path
Disallow /

grapeshot

Rule Path
Disallow /

grub-client

Rule Path
Disallow /

httrack

Rule Path
Disallow /

ia_archiver

Rule Path
Disallow /

jyxobot/1

Rule Path
Disallow /

k2spider

Rule Path
Disallow /

larbin

Rule Path
Disallow /

libwww

Rule Path
Disallow /

linkdexbot

Rule Path
Disallow /

linko

Rule Path
Disallow /

megaindex.ru

Rule Path
Disallow /

microsoft.url.control

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

msiecrawler

Rule Path
Disallow /

npbot

Rule Path
Disallow /

offline explorer

Rule Path
Disallow /

proximic

Rule Path
Disallow /

psbot

Rule Path
Disallow /

sitecheck.internetseer.com

Rule Path
Disallow /

sitesnagger

Rule Path
Disallow /

spbot

Rule Path
Disallow /

speedy

Rule Path
Disallow /

speobot

Rule Path
Disallow /

teleport

Rule Path
Disallow /

teleportpro

Rule Path
Disallow /

ubicrawler

Rule Path
Disallow /

webcopier

Rule Path
Disallow /

webreaper

Rule Path
Disallow /

webstripper

Rule Path
Disallow /

webzip

Rule Path
Disallow /

wget

Rule Path
Disallow /

xenu

Rule Path
Disallow /

yakazbot

Rule Path
Disallow /

zao

Rule Path
Disallow /

zealbot

Rule Path
Disallow /

zyborg

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.lelongtips.com.my/sitemaps/sitemap-general.xml
sitemap https://www.lelongtips.com.my/sitemaps/sitemap-listing.xml
sitemap https://www.lelongtips.com.my/sitemaps/sitemap-image.xml

Comments

  • Visit-time: 2000-2359 # 04:00-08:00 in Malaysia Time (non-peak time)
  • Visit-time: 2000-2359 # 04:00-08:00 in Malaysia Time (non-peak time)
  • Visit-time: 2000-2359 # 04:00-08:00 in Malaysia Time (non-peak time)
  • Visit-time: 2000-2359 # 04:00-08:00 in Malaysia Time (non-peak time)

Warnings

  • 2 invalid lines.