rentmen.es
robots.txt
Robots Exclusion Standard data for rentmen.es
Resource Scan
Scan Details
Site Domain | rentmen.es |
Base Domain | rentmen.es |
Scan Status | Ok |
Last Scan | 2024-11-10T02:11:04+00:00 |
Next Scan | 2024-12-10T02:11:04+00:00 |
Last Scan
Scanned | 2024-11-10T02:11:04+00:00 |
URL | https://rentmen.es/robots.txt |
Domain IPs | 104.26.2.5, 104.26.3.5, 172.67.68.225, 2606:4700:20::681a:205, 2606:4700:20::681a:305, 2606:4700:20::ac43:44e1 |
Response IP | 104.26.3.5 |
Found | Yes |
Hash | 947dd2ec4538c0f85caa7d3d659ea8caed4dde90708751767b86a5669040a6d4 |
SimHash | 2a10d8578553 |
Groups
*
Rule | Path |
---|---|
Allow | / |
Disallow | /sendgift |
Disallow | /*/submit-review |
Disallow | /signup |
Disallow | /login |
Disallow | /about/terms |
Disallow | /about/contact |
Disallow | /about/ads |
Disallow | /about/lawenforcement |
Disallow | /about/privacy |
Disallow | /about/exemption |
Disallow | /about/authentication |
Disallow | /about/antitrafficking |
Disallow | /about/complaints-policy |
Disallow | /about/content-agreement |
Disallow | /about/recurring-payment-agreement |
Disallow | /about/im |
Other Records
Field | Value |
---|---|
sitemap | https://rent.men/xml/sitemap/activities |
sitemap | https://rent.men/xml/sitemap/reviews |
sitemap | https://rent.men/xml/sitemap/profiles |
sitemap | https://rent.men/xml/sitemap/master-videos |
sitemap | https://rent.men/xml/sitemap/locations |
sitemap | https://rent.men/xml/sitemap/interviews |