sexlistclub.com
robots.txt
Robots Exclusion Standard data for sexlistclub.com
Resource Scan
Scan Details
Site Domain | sexlistclub.com |
Base Domain | sexlistclub.com |
Scan Status | Ok |
Last Scan | 2024-09-08T22:27:31+00:00 |
Next Scan | 2024-10-08T22:27:31+00:00 |
Last Scan
Scanned | 2024-09-08T22:27:31+00:00 |
URL | https://sexlistclub.com/robots.txt |
Domain IPs | 144.126.152.225 |
Response IP | 144.126.152.225 |
Found | Yes |
Hash | 4688f020d8c7709d2f6848b8ce30dc7b6b8a1af48929debdf257702bf24644bc |
SimHash | 2c10911ac5f4 |
Groups
*
Rule | Path |
---|---|
Disallow | / |
googlebot
googlebot-image
mediapartners-google
msnbot
msnbot-media
slurp
yahoo-blogs
yahoo-mmcrawler
Rule | Path |
---|---|
Disallow | /banner/ |
Disallow | /itemcw/ |
Disallow | /Jessica/ |
Disallow | /Lorena/ |
Disallow | /Patricia/ |
Disallow | /sexmond/ |
Disallow | /slider/ |
Disallow | /banner |
Disallow | /itemcw |
Disallow | /Jessica |
Disallow | /Lorena |
Disallow | /Patricia |
Disallow | /sexmond |
Disallow | /slider |
Disallow | /blockadblockEN.php |
Disallow | /blockadblockES.php |
Disallow | /blockadblockIT.php |
Disallow | /countries_sidebar.php |
Disallow | /countries_footer.php |
Disallow | /encuesta.php |
Disallow | /followus.php |
Disallow | /followusFooter.php |
Disallow | /ovelay-popup.php |
Disallow | /oc-admin |
Disallow | /comment/reply |
Disallow | /contact |
Disallow | /logout |
Disallow | /user/register |
Disallow | /user/password |
Disallow | /user/login |
Warnings
- `// disallow` is not a known field.
Comments