Log In Sign Up

jualaku.id
robots.txt

Robots Exclusion Standard data for jualaku.id

Resource Scan

Scan Details

Site Domain jualaku.id
Base Domain jualaku.id
Scan Status Ok
Last Scan2024-09-28T05:38:57+00:00
Next Scan 2024-10-05T05:38:57+00:00

Last Scan

Scanned2024-09-28T05:38:57+00:00
URL https://jualaku.id/robots.txt
Redirect https://www.jualaku.id/robots.txt
Redirect Domain www.jualaku.id
Redirect Base jualaku.id
Domain IPs 104.21.77.196, 172.67.211.109, 2606:4700:3030::6815:4dc4, 2606:4700:3030::ac43:d36d
Redirect IPs 104.21.77.196, 172.67.211.109, 2606:4700:3030::6815:4dc4, 2606:4700:3030::ac43:d36d
Response IP 172.67.211.109
Found Yes
Hash 27b2e4cf2805dad9620fbcc92e6c131099c5787c08d13d60298feb0c3c4b124a
SimHash 0e955cd18d11

Groups

*

Rule Path
Disallow /404
Disallow /*trendingpage*
Disallow /*%5Bid%5Dpage*
Disallow /*%5Bid%5Dpage*
Disallow /avatar/*

jobdiggerspider

Rule Path
Disallow /

yodaobot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

shopwiki

Rule Path
Disallow /

sosospider

Rule Path
Disallow /

yandex

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

baiduspider-image

Rule Path
Disallow /

yandeximages

Rule Path
Disallow /

applebot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

ia_archiver-web.archive.org

Rule Path
Disallow /

ia_archiver-web

Rule Path
Disallow /

ia_archiver

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

mj12bot/v1.2.5

Rule Path
Disallow /

mj12bot/v1.3.3

Rule Path
Disallow /

mj12bot/v1.4.0

Rule Path
Disallow /

twengabot-discover

Rule Path
Disallow /

twengabot/2.0

Rule Path
Disallow /

twengabot

Rule Path
Disallow /

googlebot

Rule Path
Disallow /*trendingpage*
Disallow /*%5Bid%5Dpage*
Disallow /*%5Bid%5Dpage*
Disallow /avatar/*
Disallow /.well-known/assetlinks.json
Disallow /apple-app-site-association
Disallow /icon.png
Disallow /produk-iklan/
Back to top

Other Records

Field Value
sitemap https://www.jualaku.id/sitemap.xml
sitemap https://www.jualaku.id/sitemap/kategori.xml
sitemap https://www.jualaku.id/sitemap/sub-kategori.xml
sitemap https://www.jualaku.id/sitemap/iklan.xml
sitemap https://www.jualaku.id/sitemap/user.xml
Back to top

Comments

  • *
  • Disallow: /*min=*
  • Disallow: /*max=*
  • Disallow: /*sort=*
  • Disallow: /*q=*
  • Disallow: /*kondisi=*
  • Disallow: /*location_id=*
  • Disallow: /*page=1
  • Disallow: /*?
  • Googlebot
  • Disallow: /_next/*
  • Disallow: /*min=*
  • Disallow: /*max=*
  • Disallow: /*sort=*
  • Disallow: /*q=*
  • Disallow: /*kondisi=*
  • Disallow: /*location_id=*
  • Disallow: /*page=1
  • Disallow: /*?
  • Disallow: /all-categories
  • Sitemaps
Back to top