bisnisindonesia.id
robots.txt

Robots Exclusion Standard data for bisnisindonesia.id

Resource Scan

Scan Details

Site Domain bisnisindonesia.id
Base Domain bisnisindonesia.id
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-10-23T14:20:24+00:00
Next Scan 2024-12-22T14:20:24+00:00

Last Successful Scan

Scanned2024-08-25T13:28:39+00:00
URL https://bisnisindonesia.id/robots.txt
Domain IPs 104.26.4.27, 104.26.5.27, 172.67.71.235, 2606:4700:20::681a:41b, 2606:4700:20::681a:51b, 2606:4700:20::ac43:47eb
Response IP 104.26.4.27
Found Yes
Hash 4fbac430fad556e1d76fea50b739c1011554b2216286aa4b46a184658bf75362
SimHash 8db8daeb0b53

Groups

googlebot

Rule Path
Disallow /search/*
Disallow /registration
Disallow /login
Disallow /forgot-password
Disallow /account/*

*

Rule Path
Allow /

Other Records

Field Value
sitemap https://bisnisindonesia.id/sitemap.xml

Warnings

  • 6 invalid lines.