vsem-podryad.ru
robots.txt
Robots Exclusion Standard data for vsem-podryad.ru
Resource Scan
Scan Details
Site Domain | vsem-podryad.ru |
Base Domain | vsem-podryad.ru |
Scan Status | Failed |
Failure Stage | Fetching resource. |
Failure Reason | Server returned a client error. |
Last Scan | 2024-05-28T15:38:11+00:00 |
Next Scan | 2024-06-27T15:38:11+00:00 |
Last Successful Scan
Scanned | 2024-04-29T14:04:57+00:00 |
URL | https://vsem-podryad.ru/robots.txt |
Domain IPs | 104.21.68.218, 172.67.198.247, 2606:4700:3031::6815:44da, 2606:4700:3037::ac43:c6f7 |
Response IP | 104.21.68.218 |
Found | Yes |
Hash | ae483b08f72a039dce39487e4de0f84196ea0b46d5ecdb29d4173d7595f08212 |
SimHash | 00015ac70617 |
Groups
*
Rule | Path |
---|---|
Allow | / |
Disallow | /completeregistration/ |
Disallow | /dologin/ |
Disallow | /confirmnewlogin/ |
Disallow | /pendingactivation/ |
Disallow | /passwordrecovery/ |
Disallow | /passwordrestore/ |
Disallow | /pendingloginbycode/ |
Disallow | /personalpayment/ |
Disallow | /email/ |
Disallow | /contract/ |
Disallow | /custom/oferta/ |
Disallow | /privacy-policy/ |
Disallow | /agreement/ |
Disallow | /activation/ |
Disallow | /oAuthForm/ |
Disallow | /auth/ |
Disallow | /oAuthSuccess/ |
Disallow | /oAuthFail/ |
Disallow | /custom/legality/ |
Disallow | /tooManySimultaneousSessions/ |
yandex
Rule | Path |
---|---|
Allow | / |
Disallow | /completeregistration/ |
Disallow | /dologin/ |
Disallow | /confirmnewlogin/ |
Disallow | /pendingactivation/ |
Disallow | /passwordrecovery/ |
Disallow | /passwordrestore/ |
Disallow | /pendingloginbycode/ |
Disallow | /personalpayment/ |
Disallow | /email/ |
Disallow | /contract/ |
Disallow | /custom/oferta/ |
Disallow | /privacy-policy/ |
Disallow | /agreement/ |
Disallow | /activation/ |
Disallow | /oAuthForm/ |
Disallow | /auth/ |
Disallow | /oAuthSuccess/ |
Disallow | /oAuthFail/ |
Disallow | /custom/legality/ |
Disallow | /tooManySimultaneousSessions/ |
Other Records
Field | Value |
---|---|
sitemap | https://vsem-podryad.ru/sitemap.xml |
Warnings
- `clean-param` is not a known field.
- `host` is not a known field.