bincangsyariah.com
robots.txt

Robots Exclusion Standard data for bincangsyariah.com

Resource Scan

Scan Details

Site Domain bincangsyariah.com
Base Domain bincangsyariah.com
Scan Status Failed
Failure ReasonScan timed out.
Last Scan2024-11-15T10:14:11+00:00
Next Scan 2024-11-29T10:14:11+00:00

Last Successful Scan

Scanned2024-10-31T10:13:41+00:00
URL https://bincangsyariah.com/robots.txt
Domain IPs 103.163.138.180
Response IP 103.163.138.180
Found Yes
Hash 239089a1aaef300c4ed641bb0d31b9d29ba6fe488eda3bf28acd1df698c32fff
SimHash 6a28d850c3b1

Groups

googlebot

Rule Path
Allow /
Disallow /wp-admin/

Other Records

Field Value
crawl-delay 120

slurp

Rule Path
Allow /
Disallow /wp-admin/

Other Records

Field Value
crawl-delay 120

msnbot

Rule Path
Allow /
Disallow /wp-admin/

Other Records

Field Value
crawl-delay 120

alexabot

Rule Path
Allow /
Disallow /wp-admin/

Other Records

Field Value
crawl-delay 120

twitterbot

Rule Path
Allow /
Disallow /wp-admin/

Other Records

Field Value
crawl-delay 120

*

Rule Path
Disallow /

Other Records

Field Value
sitemap https://bincangsyariah.com/sitemap_index.xml