pusaran.net
robots.txt

Robots Exclusion Standard data for pusaran.net

Resource Scan

Scan Details

Site Domain pusaran.net
Base Domain pusaran.net
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-09-16T18:00:51+00:00
Next Scan 2025-12-15T18:00:51+00:00

Last Successful Scan

Scanned2024-08-23T15:02:11+00:00
URL https://pusaran.net/robots.txt
Domain IPs 103.247.8.209, 2001:df0:27b:2::7:820c
Response IP 103.247.8.209
Found Yes
Hash ec9e587f567e4f3110c20a2840c3df7f1502b24a538c3387490d728f55d5ee54
SimHash 490ccb725691

Groups

*

Rule Path
Disallow /api/
Disallow */trackback/

mediapartners-google*

Rule Path
Allow /

googlebot-image
adsbot-google

Rule Path
Allow /

googlebot-mobile

Rule Path
Allow /

Other Records

Field Value
sitemap https://jatimupdate.id/sitemap.xml

Comments

  • disallow all files in these directories
  • Disallow: /*?*