disway.id
robots.txt

Robots Exclusion Standard data for disway.id

Resource Scan

Scan Details

Site Domain disway.id
Base Domain disway.id
Scan Status Ok
Last Scan2026-02-05T19:14:49+00:00
Next Scan 2026-02-12T19:14:49+00:00

Last Scan

Scanned2026-02-05T19:14:49+00:00
URL https://disway.id/robots.txt
Domain IPs 104.26.14.37, 104.26.15.37, 172.67.75.73, 2606:4700:20::681a:e25, 2606:4700:20::681a:f25, 2606:4700:20::ac43:4b49
Response IP 104.26.14.37
Found Yes
Hash e175e3ae363f515234ddadbfccd5951df9f5b0bec98cce1d45e9c98f48d17c9e
SimHash 8b5551578d53

Groups

googlebot

Rule Path
Disallow /search/*
Disallow /cariconvertpagging/*

*

Rule Path
Allow /

Other Records

Field Value
sitemap https://disway.id/sitemap.xml
sitemap https://disway.id/sitemap/index.xml
sitemap https://disway.id/sitemap/image.xml
sitemap https://disway.id/sitemap/tag.xml
sitemap https://disway.id/sitemap/taglong.xml
sitemap https://disway.id/frontend/sitemapgoogle
sitemap https://disway.id/frontend/sitemap