blackexpo.id
robots.txt
Robots Exclusion Standard data for blackexpo.id
Resource Scan
Scan Details
Site Domain | blackexpo.id |
Base Domain | blackexpo.id |
Scan Status | Failed |
Failure Stage | Fetching resource. |
Failure Reason | Server returned a client error. |
Last Scan | 2025-07-18T01:30:58+00:00 |
Next Scan | 2025-09-16T01:30:58+00:00 |
Last Successful Scan
Scanned | 2025-05-19T17:23:42+00:00 |
URL | https://blackexpo.id/robots.txt |
Domain IPs | 5.181.216.191 |
Response IP | 5.181.216.191 |
Found | Yes |
Hash | 6040cb0bce70997fa694909b52fd70bcaa2f8cd626a122a99a80617041ddd203 |
SimHash | 6e0d35986fd6 |
Groups
*
Rule | Path |
---|---|
Disallow | /admincp |
Disallow | /admin-cp |
Disallow | /admin-panel |
Disallow | /aj/* |
Disallow | /ajax |
Disallow | /api |
Disallow | /app_api |
Disallow | /cache |
Disallow | /embed |
Disallow | /nodejs |
Disallow | /sources |
Disallow | /updates |
Disallow | /?provider=* |
Disallow | /?lang=* |
Disallow | /?to=* |
Other Records
Field | Value |
---|---|
sitemap | https://blackexpo.id/sitemap-main.xml |
sitemap | https://blackexpo.id/sitemap.xml |
Comments