blackexpo.id
robots.txt

Robots Exclusion Standard data for blackexpo.id

Resource Scan

Scan Details

Site Domain blackexpo.id
Base Domain blackexpo.id
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-07-18T01:30:58+00:00
Next Scan 2025-09-16T01:30:58+00:00

Last Successful Scan

Scanned2025-05-19T17:23:42+00:00
URL https://blackexpo.id/robots.txt
Domain IPs 5.181.216.191
Response IP 5.181.216.191
Found Yes
Hash 6040cb0bce70997fa694909b52fd70bcaa2f8cd626a122a99a80617041ddd203
SimHash 6e0d35986fd6

Groups

mediapartners-google

Rule Path
Disallow

*

Rule Path
Disallow /admincp
Disallow /admin-cp
Disallow /admin-panel
Disallow /aj/*
Disallow /ajax
Disallow /api
Disallow /app_api
Disallow /cache
Disallow /embed
Disallow /nodejs
Disallow /sources
Disallow /updates
Disallow /?provider=*
Disallow /?lang=*
Disallow /?to=*

Other Records

Field Value
sitemap https://blackexpo.id/sitemap-main.xml
sitemap https://blackexpo.id/sitemap.xml

Comments

  • Hello search engine
  • I am robots.txt
  • I am very happy to be crawled