dar.sex
robots.txt
Robots Exclusion Standard data for dar.sex
Resource Scan
Scan Details
Site Domain | dar.sex |
Base Domain | dar.sex |
Scan Status | Ok |
Last Scan | 2025-03-02T15:30:01+00:00 |
Next Scan | 2025-04-01T15:30:01+00:00 |
Last Scan
Scanned | 2025-03-02T15:30:01+00:00 |
URL | https://dar.sex/robots.txt |
Domain IPs | 104.21.89.95, 172.67.139.185, 2606:4700:3031::ac43:8bb9, 2606:4700:3037::6815:595f |
Response IP | 172.67.139.185 |
Found | Yes |
Hash | cdccefb5ec38ab3ba9b229242061495600acdeaa68deb79a5ba6582972299b56 |
SimHash | 745ddc564d11 |
Groups
*
Rule | Path |
---|---|
Disallow | /captcha/ |
Disallow | /en/captcha/ |
Disallow | /management/ |
Disallow | /account/ |
Disallow | */board/* |
Disallow | */theme/* |
Disallow | /404.html |
Disallow | /services/ |
Disallow | /license/ |
Disallow | /en/services/ |
Disallow | /en/license/ |
Other Records
Field | Value |
---|---|
sitemap | https://dar.sex/sitemap.xml |