senggang.republika.co.id
robots.txt
Robots Exclusion Standard data for senggang.republika.co.id
Resource Scan
Scan Details
Site Domain | senggang.republika.co.id |
Base Domain | republika.co.id |
Scan Status | Ok |
Last Scan | 2024-10-08T05:28:16+00:00 |
Next Scan | 2024-10-15T05:28:16+00:00 |
Last Scan
Scanned | 2024-10-08T05:28:16+00:00 |
URL | https://senggang.republika.co.id/robots.txt |
Domain IPs | 104.18.8.234, 104.18.9.234, 2606:4700::6812:8ea, 2606:4700::6812:9ea |
Response IP | 104.18.9.234 |
Found | Yes |
Hash | 1f24c2e28df419d6e8ca7c867bfb2443ce747a7ac4ffb865e7df1bde29db6008 |
SimHash | 15117c78eef3 |
Groups
*
Rule | Path |
---|---|
Disallow | /search/?q= |
Disallow | /komentar/* |
Disallow | /copy/* |
Disallow | /cron/* |
Disallow | /curl/* |
Disallow | /feed/* |
Disallow | /tag/* |
Disallow | /post/* |
Disallow | /ajax/* |
Disallow | *?utm_source=* |
Disallow | *?source=* |
Other Records
Field | Value |
---|---|
sitemap | https://www.republika.co.id/files/xml/sitemap.xml |