afrosex.com
robots.txt
Robots Exclusion Standard data for afrosex.com
Resource Scan
Scan Details
Site Domain | afrosex.com |
Base Domain | afrosex.com |
Scan Status | Ok |
Last Scan | 4/28/2025, 3:38:20 PM |
Next Scan | 5/28/2025, 3:38:20 PM |
Last Scan
Scanned | 4/28/2025, 3:38:20 PM |
URL | https://afrosex.com/robots.txt |
Domain IPs | 88.85.64.44 |
Response IP | 88.85.64.44 |
Found | Yes |
Hash | 157644d2dc4b7cb43cad20a2f0f6f4b460590da7fa2f37124830abcbe35fe3d1 |
SimHash | 812a98326990 |
Groups
*
Rule | Path |
---|---|
Allow | / |
Disallow | /*/search/ |
Disallow | /videos/ |
Disallow | /out/ |
Disallow | *?filter* |
Disallow | /o.php |
Disallow | /emb |
Disallow | /suggestions |
Disallow | /reports |
Disallow | /fpi |
Disallow | *?tst* |
Other Records
Field | Value |
---|---|
sitemap | https://afrosex.com/sitemap.xml |