bigsextits.com
robots.txt

Robots Exclusion Standard data for bigsextits.com

Resource Scan

Scan Details

Site Domain bigsextits.com
Base Domain bigsextits.com
Scan Status Ok
Last Scan2025-10-28T23:50:40+00:00
Next Scan 2025-11-27T23:50:40+00:00

Last Scan

Scanned2025-10-28T23:50:40+00:00
URL https://bigsextits.com/robots.txt
Domain IPs 156.254.75.221
Response IP 156.254.75.221
Found Yes
Hash ebde819fd1b6e1f985896334372949a6e6572139918c85fa9ff1890f74919937
SimHash 4a1c8260fb91

Groups

alphabot

Rule Path
Disallow /

wotbox

Rule Path
Disallow /

megaindex

Rule Path
Disallow /

safednsbot

Rule Path
Disallow /

exabot

Rule Path
Disallow /

obot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

jikespider

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

yandexbot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

deusu

Rule Path
Disallow /

grapeshot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

*

Rule Path
Allow /