terasjakarta.id
robots.txt

Robots Exclusion Standard data for terasjakarta.id

Resource Scan

Scan Details

Site Domain terasjakarta.id
Base Domain terasjakarta.id
Scan Status Failed
Failure ReasonScan timed out.
Last Scan2024-09-20T04:59:33+00:00
Next Scan 2024-11-19T04:59:33+00:00

Last Successful Scan

Scanned2024-06-30T04:17:02+00:00
URL https://www.terasjakarta.id/robots.txt
Redirect https://terasjakarta.id/robots.txt
Redirect Domain terasjakarta.id
Redirect Base terasjakarta.id
Domain IPs 104.21.93.170, 172.67.213.66, 2606:4700:3031::6815:5daa, 2606:4700:3033::ac43:d542
Redirect IPs 104.21.93.170, 172.67.213.66, 2606:4700:3031::6815:5daa, 2606:4700:3033::ac43:d542
Response IP 172.67.213.66
Found Yes
Hash db76c6d6737fb3a82ff84eb83356d1a59cf320b0934ab448875703a30543fdaf
SimHash 2905c845cb90

Groups

*

Rule Path
Disallow /search/*
Disallow /api/*
Disallow /tag/*

Other Records

Field Value
sitemap https://terasjakarta.id/sitemap.xml

Warnings

  • 2 invalid lines.