scan-words.ru
robots.txt
Robots Exclusion Standard data for scan-words.ru
Resource Scan
Scan Details
Site Domain | scan-words.ru |
Base Domain | scan-words.ru |
Scan Status | Ok |
Last Scan | 2024-09-24T05:04:25+00:00 |
Next Scan | 2024-10-01T05:04:25+00:00 |
Last Scan
Scanned | 2024-09-24T05:04:25+00:00 |
URL | https://scan-words.ru/robots.txt |
Domain IPs | 195.2.76.203 |
Response IP | 195.2.76.203 |
Found | Yes |
Hash | ad4138da4a3854e4c327c993bad2ce06da312721ef8702fd63ab63d80080e73c |
SimHash | 804cd2616333 |
Groups
*
Rule | Path |
---|---|
Disallow | / |
Allow | /index.html |
Allow | /press_ru.html |
Allow | /policy.html |
Allow | /policy_new.html |
Allow | /en.html |
Allow | /ru.html |
Allow | /erudit3dpolicy.html |
Allow | /erudit3dterms.html |
Allow | /howto.html |
Allow | /pbookpolicy.html |
Allow | /policy.html |
Allow | /policy_new.html |
Allow | /privacy-policy-puzzlebook.html |
Allow | /puzzleterms.html |
Allow | /scanadremove.html |
Allow | /scanhints.html |