garasi.id
robots.txt

Robots Exclusion Standard data for garasi.id

Resource Scan

Scan Details

Site Domain garasi.id
Base Domain garasi.id
Scan Status Ok
Last Scan2024-09-28T16:50:49+00:00
Next Scan 2024-10-05T16:50:49+00:00

Last Scan

Scanned2024-09-28T16:50:49+00:00
URL https://garasi.id/robots.txt
Domain IPs 104.18.24.101, 104.18.25.101
Response IP 104.18.24.101
Found Yes
Hash a5662d0fca3e94d6ff1296314645f9c8de7725233aa776fbbcfc7f4710fb3e7c
SimHash 48155a32c551

Groups

baiduspider

Rule Path
Disallow /

caribot

Rule Path
Disallow /

trovitbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

yandex

Rule Path
Disallow /

paracrawl

Rule Path
Disallow /

teracent-feed-processing

Rule Path
Disallow /

*

Rule Path
Disallow /403
Disallow /404
Disallow /admin/
Disallow /api/
Disallow /index.html
Allow /account
Allow /account/login
Allow /account/register
Disallow /account/
Disallow /feedback
Disallow /kupon
Disallow /notifikasi
Disallow /payment
Disallow /transaksi
Disallow /voucher

Other Records

Field Value
crawl-delay 10

googlebot

Rule Path
Allow /api/

Other Records

Field Value
sitemap https://garasi.id/sitemap/index.xml