bijlibachao.com
robots.txt

Robots Exclusion Standard data for bijlibachao.com

Resource Scan

Scan Details

Site Domain bijlibachao.com
Base Domain bijlibachao.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-08-29T21:20:22+00:00
Next Scan 2024-11-27T21:20:22+00:00

Last Successful Scan

Scanned2023-11-04T13:55:54+00:00
URL https://bijlibachao.com/robots.txt
Domain IPs 104.26.4.186, 104.26.5.186, 172.67.68.120, 2606:4700:20::681a:4ba, 2606:4700:20::681a:5ba, 2606:4700:20::ac43:4478
Response IP 172.67.68.120
Found Yes
Hash 231a403757fb7edd6342246f3dda09a27735af3a98219a2418d8c9da11f695fc
SimHash 6904d8608193

Groups

*

Rule Path
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php

*

Rule Path
Disallow /?s=
Disallow /search/

gptbot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.bijlibachao.com/sitemap_index.xml