freesoft.net
robots.txt
Robots Exclusion Standard data for freesoft.net
Resource Scan
Scan Details
| Site Domain | freesoft.net |
| Base Domain | freesoft.net |
| Scan Status | Ok |
| Last Scan | 2024-11-13T12:45:16+00:00 |
| Next Scan | 2024-11-20T12:45:16+00:00 |
Last Scan
| Scanned | 2024-11-13T12:45:16+00:00 |
| URL | https://freesoft.net/robots.txt |
| Domain IPs | 104.21.16.230, 172.67.216.208, 2606:4700:3031::6815:10e6, 2606:4700:3033::ac43:d8d0 |
| Response IP | 172.67.216.208 |
| Found | Yes |
| Hash | 07a2fd27a035ec3dad4ae62e91bb2eadc0c1884b0b995653785b23a562cfa514 |
| SimHash | a82dcd27d7f0 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /search/ |
| Disallow | /test/ |
| Disallow | /api/ |
| Disallow | /auth/ |
| Disallow | /developer/ |
| Disallow | */comment$ |
| Disallow | /yandex-browser.html |
| Disallow | /author/ |
| Disallow | /clicks/ |
| Disallow | /other* |
| Disallow | /files/ |
| Disallow | /redirect2.php* |
| Disallow | /rep/ |
| Disallow | /*?sort=* |
| Disallow | /?adv=* |
| Disallow | /search* |
| Disallow | /?sec=* |
| Disallow | /?id=* |
| Disallow | /*showtopic%3D* |
| Disallow | /*id%3D* |
| Disallow | /*hl%3Dru_ru |
| Disallow | /?aid=* |
| Disallow | /*?clid=* |
| Disallow | /?hcb=* |
| Disallow | /?from=* |
| Disallow | /*?sa=* |
| Disallow | /*?platform=* |
| Disallow | /?a=* |
| Disallow | /*?app=* |
| Disallow | /*?_utl_t=* |
| Disallow | /index.php/ |
| Disallow | /*?js_checking=* |
| Disallow | /*?_gl=* |
| Allow | /css/*.css |
| Allow | /js/*.js |
Other Records
| Field | Value |
|---|---|
| sitemap | https://freesoft.net/sitemap.xml |