monetapay.id
robots.txt

Robots Exclusion Standard data for monetapay.id

Resource Scan

Scan Details

Site Domain monetapay.id
Base Domain monetapay.id
Scan Status Ok
Last Scan2026-01-11T00:52:07+00:00
Next Scan 2026-02-10T00:52:07+00:00

Last Scan

Scanned2026-01-11T00:52:07+00:00
URL https://www.monetapay.id/robots.txt
Domain IPs 104.21.64.237, 172.67.188.51, 2606:4700:3030::ac43:bc33, 2606:4700:3033::6815:40ed
Response IP 104.21.64.237
Found Yes
Hash 6a8503acdb56d76471abaccfca766a3cb2f4c2abc31c6477ec8f4bba08990808
SimHash 38633b22c3b5

Groups

*

Rule Path
Allow /
Disallow /node_modules/
Disallow /.idea/
Disallow /assets/
Disallow /package-lock.json
Disallow /package.json
Disallow /deploy.sh
Disallow /tailwind.config.js

Comments

  • Crawling bot rules only allow inside website directory