agentapp.ru
robots.txt
Robots Exclusion Standard data for agentapp.ru
Resource Scan
Scan Details
| Site Domain | agentapp.ru |
| Base Domain | agentapp.ru |
| Scan Status | Ok |
| Last Scan | 2025-03-08T15:15:06+00:00 |
| Next Scan | 2025-04-07T15:15:06+00:00 |
Last Scan
| Scanned | 2025-03-08T15:15:06+00:00 |
| URL | https://agentapp.ru/robots.txt |
| Domain IPs | 185.129.100.112 |
| Response IP | 185.129.100.112 |
| Found | Yes |
| Hash | 9637f1bb598109f25380fb875538480d80cbfc30c5349f9737c8ed34123d229c |
| SimHash | ab319c19ec72 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /page7434852.html |
| Disallow | /testpage |
| Disallow | /page9774350.html |
| Disallow | /banner |
| Disallow | /page9954639.html |
| Disallow | /b2b-frame |
| Disallow | /page6343395.html |
| Disallow | /header |
| Disallow | /page7162853.html |
| Disallow | /footer |
| Disallow | /page7448678.html |
| Disallow | /iframe |
| Disallow | /page7448802.html |
| Disallow | /no_iframe |
| Disallow | /page7449675.html |
| Disallow | /frame_header__noavtocode |
| Disallow | /page7449732.html |
| Disallow | /iframe_change_step_noheader |
| Disallow | /page7450542.html |
| Disallow | /without_min_rate |
| Disallow | /page34308246.html |
| Disallow | /other-cms |
| Disallow | /page36263246.html |
| Disallow | /hdev |
| Disallow | /page36334102.html |
| Disallow | /dev-legal |
| Disallow | /page36890166.html |
| Disallow | /test-sber |
| Disallow | /page10031287.html |
| Disallow | /b2b-frame-old |
| Disallow | /page50482337.html |
| Disallow | /tilda/form* |
| Disallow | /tilda/rec* |
| Disallow | /tilda/click* |
| Disallow | /tilda/scroll* |
| Disallow | /tilda/popup* |
| Disallow | /tilda/cart* |
| Disallow | /tilda/product* |
| Disallow | /tilda/event* |
| Disallow | /*_escaped_fragment_* |
| Disallow | /members/login* |
| Disallow | /members/signup* |
| Disallow |
Other Records
| Field | Value |
|---|---|
| sitemap | https://agentapp.ru/sitemap.xml |
| sitemap | https://agentapp.ru/sitemap-feeds.xml |
Warnings
- `host` is not a known field.