Log In Sign Up

tuwaga.id
robots.txt

Robots Exclusion Standard data for tuwaga.id

Resource Scan

Scan Details

Site Domain tuwaga.id
Base Domain tuwaga.id
Scan Status Ok
Last Scan2026-01-31T02:19:36+00:00
Next Scan 2026-02-07T02:19:36+00:00

Last Scan

Scanned2026-01-31T02:19:36+00:00
URL https://tuwaga.id/robots.txt
Domain IPs 104.26.2.150, 104.26.3.150, 172.67.71.166, 2606:4700:20::681a:296, 2606:4700:20::681a:396, 2606:4700:20::ac43:47a6
Response IP 104.26.3.150
Found Yes
Hash 5c6824b12f9b5b1ad2aedd20aa958cfb2391fa96c9b065ce654541ab3f91c6f2
SimHash 8b445880c631

Groups

*

Rule Path
Allow /
Allow /wp-content/uploads/
Disallow /wp-admin/
Disallow /wp-includes/
Disallow /page/*
Disallow /login/
Disallow /profile-user-view-creator/page/*
Disallow /lead-submissions?*
Disallow /promo/?*
Disallow /promo/*?*
Disallow /promo/merchant/*/?*
Disallow /promo/merchant/*?*
Disallow /artikel/*/?source=*
Disallow /artikel/*/?read=*

googlebot-news

Rule Path
Allow /

adsbot-google

Rule Path
Disallow /404

mediapartners-google

Rule Path
Disallow /404
Back to top

Other Records

Field Value
sitemap https://tuwaga.id/sitemap_index.xml
Back to top

Comments

  • Disallow: /wp-content/cache/
  • Disallow: /artikel/*/?*
Back to top