bjj.co.id
robots.txt

Robots Exclusion Standard data for bjj.co.id

Resource Scan

Scan Details

Site Domain bjj.co.id
Base Domain bjj.co.id
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-06-09T18:22:48+00:00
Next Scan 2024-09-07T18:22:48+00:00

Last Successful Scan

Scanned2023-10-21T11:45:42+00:00
URL https://bjj.co.id/robots.txt
Redirect https://www.bjj.co.id/robots.txt
Redirect Domain www.bjj.co.id
Redirect Base bjj.co.id
Domain IPs 103.6.52.23
Redirect IPs 184.87.193.69, 184.87.193.81, 2600:1413:b000:1e::17d1:2e45, 2600:1413:b000:1e::17d1:2e48
Response IP 23.46.16.117
Found Yes
Hash 6fd4849200508f5dc50fcbcfd2eec7137bcaf00c03e99218abad93ace01a9cd9
SimHash a811cb73c1db

Groups

*

Rule Path
Allow /
Allow /sitemap.htm
Disallow /cgi-bin/
Disallow /M4HJGGV_aSuK/
Disallow /web/M4HJGGV_aSuK/
Disallow /config
Disallow /css/
Disallow /js/
Disallow /x99d0wnl0d/

Other Records

Field Value
sitemap http://www.bjj.co.id/sitemap.xml