bibitik.com
robots.txt

Robots Exclusion Standard data for bibitik.com

Resource Scan

Scan Details

Site Domain bibitik.com
Base Domain bibitik.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a server error.
Last Scan2024-11-04T21:59:48+00:00
Next Scan 2024-11-11T21:59:48+00:00

Last Successful Scan

Scanned2024-10-27T15:41:34+00:00
URL https://bibitik.com/robots.txt
Redirect https://www.bibitik.com/robots.txt
Redirect Domain www.bibitik.com
Redirect Base bibitik.com
Domain IPs 104.21.14.89, 172.67.158.136, 2606:4700:3031::ac43:9e88, 2606:4700:3036::6815:e59
Redirect IPs 104.21.14.89, 172.67.158.136, 2606:4700:3031::ac43:9e88, 2606:4700:3036::6815:e59
Response IP 172.67.158.136
Found Yes
Hash 826004ae964ae0a8a198b147d0ad221389d9b97055f1c96b2019deeff75a5541
SimHash 5c1488004711

Groups

*

Rule Path
Disallow /embed/*
Allow /sitemap.xml