karawangbekasi.disway.id
robots.txt

Robots Exclusion Standard data for karawangbekasi.disway.id

Resource Scan

Scan Details

Site Domain karawangbekasi.disway.id
Base Domain disway.id
Scan Status Ok
Last Scan2024-05-10T13:09:12+00:00
Next Scan 2024-06-09T13:09:12+00:00

Last Scan

Scanned2024-05-10T13:09:12+00:00
URL https://karawangbekasi.disway.id/robots.txt
Domain IPs 104.26.14.37, 104.26.15.37, 172.67.75.73, 2606:4700:20::681a:e25, 2606:4700:20::681a:f25, 2606:4700:20::ac43:4b49
Response IP 104.26.14.37
Found Yes
Hash ad3a3e203fd371aac4af694e54188d68b3783100b3b010d70f74fa4b4ff59c77
SimHash 4d4d81554391

Groups

*
googlebot

Rule Path
Allow /

Other Records

Field Value
sitemap https://karawangbekasi.disway.id/sitemap.xml
sitemap https://karawangbekasi.disway.id/sitemap/index.xml
sitemap https://karawangbekasi.disway.id/sitemap/image.xml
sitemap https://karawangbekasi.disway.id/sitemap/tag.xml
sitemap https://karawangbekasi.disway.id/frontend/sitemapgoogle
sitemap https://karawangbekasi.disway.id/frontend/sitemap