creditcat.ru
robots.txt
Robots Exclusion Standard data for creditcat.ru
Resource Scan
Scan Details
Site Domain | creditcat.ru |
Base Domain | creditcat.ru |
Scan Status | Ok |
Last Scan | 2024-10-30T10:45:56+00:00 |
Next Scan | 2024-11-06T10:45:56+00:00 |
Last Scan
Scanned | 2024-10-30T10:45:56+00:00 |
URL | https://creditcat.ru/robots.txt |
Domain IPs | 109.238.90.73 |
Response IP | 109.238.90.73 |
Found | Yes |
Hash | e82865f5d0dbd113564c3088eb703a2419c5370c5ab7fab60dc07992a06bd125 |
SimHash | 6d1c9e7448f4 |
Groups
*
Rule | Path |
---|---|
Disallow | /wm_devtek_2215 |
Disallow | /wm_devtek_4755 |
Disallow | /wm_devtek_2471 |
Disallow | /wm_devtek_2470 |
Disallow | /wm_devtek_2021 |
Disallow | /wm_devtek_2288 |
Disallow | /wm_devtek_9991 |
Disallow | /wm_devtek_5029 |
Disallow | /wm_devtek_2022 |
Disallow | /wm_devtek_2215 |
Disallow | /wm_devtek_2458 |
Other Records
Field | Value |
---|---|
crawl-delay | 120 |
Other Records
Field | Value |
---|---|
sitemap | https://creditcat.ru/sitemap.xml |