babr24.com
robots.txt

Robots Exclusion Standard data for babr24.com

Resource Scan

Scan Details

Site Domain babr24.com
Base Domain babr24.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-01-29T14:40:19+00:00
Next Scan 2025-04-29T14:40:19+00:00

Last Successful Scan

Scanned2024-01-06T09:19:56+00:00
URL https://babr24.com/robots.txt
Domain IPs 104.21.26.98, 172.67.135.215, 2606:4700:3033::6815:1a62, 2606:4700:3035::ac43:87d7
Response IP 104.21.26.98
Found Yes
Hash 20722bf7dcb1488455c209d031ae5a3638b89306386005613150ae1ee83ac78d
SimHash 0d990d4566d3

Groups

*

Rule Path
Disallow /cgi-bin/

Other Records

Field Value
sitemap http://babr24.com/sitemap.xml
sitemap http://babr24.com/sitemap1.xml
sitemap http://babr24.com/sitemap2.xml
sitemap http://babr24.com/sitemap3.xml
sitemap http://babr24.com/sitemap4.xml
sitemap http://babr24.com/sitemap5.xml
sitemap http://babr24.com/sitemap6.xml
sitemap http://babr24.com/sitemap7.xml
sitemap http://babr24.com/sitemap8.xml
sitemap http://babr24.com/sitemap9.xml
sitemap http://babr24.com/sitemap10.xml
sitemap http://babr24.com/sitemap11.xml
sitemap http://babr24.com/sitemap12.xml

Warnings

  • `host` is not a known field.