sexlovs.ru
robots.txt
Robots Exclusion Standard data for sexlovs.ru
Resource Scan
Scan Details
| Site Domain | sexlovs.ru |
| Base Domain | sexlovs.ru |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Couldn't connect to server. |
| Last Scan | 2024-04-08T21:11:40+00:00 |
| Next Scan | 2024-07-07T21:11:40+00:00 |
Last Successful Scan
| Scanned | 2022-03-31T04:32:49+00:00 |
| URL | http://sexlovs.ru/robots.txt |
| Redirect | https://involta.ru/robots.txt |
| Redirect Domain | involta.ru |
| Redirect Base | involta.ru |
| Response IP | 88.99.228.104 |
| Found | Yes |
| Hash | 8d468ea4c15207bdc688c428c11e3d6e45962f3ce2b671540d5b041cd54db945 |
| SimHash | c108840d2d12 |
Groups
*
| Rule | Path |
|---|---|
| Allow | / |
| Disallow | /blog/admin |
| Disallow | /*ref%3D |
| Disallow | /?link=* |
| Disallow | /*extension%3D* |
| Disallow | /mailer.php |
| Disallow | /tools/short-links/ |
| Disallow | /tools/elements/open-graph/music-radio-station/ |
| Disallow | /vacancies |
| Disallow | /tools/youtube-preview/ |
| Disallow | /tools/page-speed/ |
| Disallow | /tools/whois/ |
| Disallow | /tools/response-status/ |
| Allow | /vacancies/$ |
| Allow | /tools/whois/$ |
| Allow | /tools/response-status/$ |
| Allow | /tools/youtube-preview/$ |
| Allow | /tools/page-speed/$ |
| Allow | /tools/short-links/$ |
| Allow | /tools/short-links/en/$ |
| Allow | /tools/short-links/*.css |
| Allow | /tools/short-links/*.js |
| Allow | /tools/short-links/*.svg |
| Allow | /tools/short-links/*.png |
| Allow | /tools/short-links/*.jpg |
Other Records
| Field | Value |
|---|---|
| sitemap | https://involta.ru/sitemap.xml |