batarabe.asia
robots.txt

Robots Exclusion Standard data for batarabe.asia

Resource Scan

Scan Details

Site Domain batarabe.asia
Base Domain batarabe.asia
Scan Status Ok
Last Scan2025-04-03T16:12:28+00:00
Next Scan 2025-05-03T16:12:28+00:00

Last Scan

Scanned2025-04-03T16:12:28+00:00
URL https://batarabe.asia/robots.txt
Domain IPs 104.21.96.78, 172.67.174.74, 2606:4700:3030::6815:604e, 2606:4700:3035::ac43:ae4a
Response IP 104.21.96.78
Found Yes
Hash 6e022d04aa146c6c6777c5cc56464dab7b85a36391db20097a0adca6bdec1398
SimHash 4914d895c791

Groups

googlebot
slurp
bingbot

Rule Path
Allow /

*

Rule Path
Allow /

ia_archiver

Rule Path
Disallow /

Other Records

Field Value
sitemap https://batarabe.asia/sitemap.xml