progres.id
robots.txt

Robots Exclusion Standard data for progres.id

Resource Scan

Scan Details

Site Domain progres.id
Base Domain progres.id
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-07-06T01:25:24+00:00
Next Scan 2025-09-04T01:25:24+00:00

Last Successful Scan

Scanned2025-05-08T00:58:59+00:00
URL https://progres.id/robots.txt
Domain IPs 36.50.77.116
Response IP 36.50.77.116
Found Yes
Hash c379f7d2abc0275268cf5cad8ac00d53c08341b5ccdf7c9b0e2ad8e65bd13d17
SimHash c948c8c0a49b

Groups

*

Rule Path
Disallow /?s=
Disallow /page/*/?s=
Disallow /search/

Other Records

Field Value
sitemap https://progres.id/sitemap_index.xml

Comments

  • START YOAST BLOCK
  • ---------------------------
  • ---------------------------
  • END YOAST BLOCK