sexindians.cc
robots.txt

Robots Exclusion Standard data for sexindians.cc

Resource Scan

Scan Details

Site Domain sexindians.cc
Base Domain sexindians.cc
Scan Status Ok
Last Scan3/20/2025, 4:20:49 AM
Next Scan 4/19/2025, 4:20:49 AM

Last Scan

Scanned3/20/2025, 4:20:49 AM
URL https://sexindians.cc/robots.txt
Domain IPs 104.21.62.253, 172.67.168.240, 2606:4700:3033::6815:3efd, 2606:4700:3037::ac43:a8f0
Response IP 172.67.168.240
Found Yes
Hash 5b960edd34d860bc9737d74206bd711eaa641ef5971992d777228b2479f34cdd
SimHash 6f98dc41c7d1

Groups

bingbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 40

*

Rule Path
Disallow */2257/
Disallow */dmca/
Disallow */terms/
Disallow */video/*
Disallow */report.php
Disallow */croper

Other Records

Field Value
sitemap https://sexindians.cc/sitemap.xml