batikpkfriend.com
robots.txt

Robots Exclusion Standard data for batikpkfriend.com

Resource Scan

Scan Details

Site Domain batikpkfriend.com
Base Domain batikpkfriend.com
Scan Status Ok
Last Scan5/22/2025, 2:39:57 AM
Next Scan 6/21/2025, 2:39:57 AM

Last Scan

Scanned5/22/2025, 2:39:57 AM
URL https://batikpkfriend.com/robots.txt
Redirect https://batikemilau.com/robots.txt
Redirect Domain batikemilau.com
Redirect Base batikemilau.com
Domain IPs 104.21.56.220, 172.67.156.31, 2606:4700:3032::6815:38dc, 2606:4700:3035::ac43:9c1f
Redirect IPs 138.199.46.68, 2400:52e0:1500::1274:1
Response IP 138.199.46.65
Found Yes
Hash 311686328659510f747327e026c7c5e2c4ff565c36593bf6903258e82059d463
SimHash 2451d7025587

Groups

googlebot

Rule Path
Disallow

googlebot-image

Rule Path
Disallow

googlebot-mobile

Rule Path
Disallow

msnbot

Rule Path
Disallow

slurp

Rule Path
Disallow

teoma

Rule Path
Disallow

gigabot

Rule Path
Disallow

robozilla

Rule Path
Disallow

nutch

Rule Path
Disallow

ia_archiver

Rule Path
Disallow

baiduspider

Rule Path
Disallow

naverbot

Rule Path
Disallow

yeti

Rule Path
Disallow

yahoo-mmcrawler

Rule Path
Disallow

psbot

Rule Path
Disallow

yahoo-blogs/v3.9

Rule Path
Disallow

*

Rule Path
Disallow
Disallow /cgi-bin/

Other Records

Field Value
sitemap batikemilau.com

Warnings

  • 1 invalid line.