Log In Sign Up

orientalbabes.xyz
robots.txt

Robots Exclusion Standard data for orientalbabes.xyz

Resource Scan

Scan Details

Site Domain orientalbabes.xyz
Base Domain orientalbabes.xyz
Scan Status Ok
Last Scan2025-05-28T07:34:41+00:00
Next Scan 2025-06-27T07:34:41+00:00

Last Scan

Scanned2025-05-28T07:34:41+00:00
URL https://orientalbabes.xyz/robots.txt
Domain IPs 104.21.89.24, 172.67.136.83, 2606:4700:3030::6815:5918, 2606:4700:3031::ac43:8853
Response IP 172.67.136.83
Found Yes
Hash 9ce2ab2af0c9aff10c45ac5c5b60cf40a53ef9e320623c04a3b75a3c06423f7e
SimHash 521f1d609e11

Groups

ahrefsbot

Rule Path
Disallow /

barkrowler

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

cloudfind

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

riddler

Rule Path
Disallow /

seekportbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

semrushbot-sa

Rule Path
Disallow /

the knowledge ai

Rule Path
Disallow /

webmeupbot

Rule Path
Disallow /

seokicks bot

Rule Path
Disallow /

amazonbot

Rule Path
Disallow /

ezooms

Rule Path
Disallow /

tinytestbot

Rule Path
Disallow /

chatgpt-user

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

anthropic-ai

Rule Path
Disallow /

claude-web

Rule Path
Disallow /

google-extended

Rule Path
Disallow /

*

Rule Path
Disallow /cgi-bin
Disallow /abuse.php
Disallow /contacts.php
Disallow /parentalcontrol.php
Disallow /terms.php
Disallow /*?sort=new$
Disallow /*?sort=long$
Disallow /asearch?f_
Back to top

Other Records

Field Value
sitemap https://orientalbabes.xyz/sitemap.xml
Back to top