batner.com
robots.txt

Robots Exclusion Standard data for batner.com

Resource Scan

Scan Details

Site Domain batner.com
Base Domain batner.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-06-17T15:01:29+00:00
Next Scan 2025-07-01T15:01:29+00:00

Last Successful Scan

Scanned2025-06-02T14:02:54+00:00
URL https://batner.com/robots.txt
Domain IPs 104.21.73.27, 172.67.137.249, 2606:4700:3033::6815:491b, 2606:4700:3035::ac43:89f9
Response IP 104.21.73.27
Found Yes
Hash ba5154e86cd408773da85d287f228cea10b6fbd448a48f789a247592be896b2b
SimHash 21512b737211

Groups

*

Rule Path
Allow /
Allow /media/item/
Allow /images/
Disallow /cgi-bin/

googlebot

Rule Path
Disallow

googlebot-mobile

Rule Path
Disallow

adsbot-google

Rule Path
Disallow

googlebot-image

Rule Path
Disallow

semrushbot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://batner.com/sitemap.xml
sitemap https://batner.com/image-sitemap.xml
sitemap https://batner.com/videos.xml