credit24.lt
robots.txt
Robots Exclusion Standard data for credit24.lt
Resource Scan
Scan Details
| Site Domain | credit24.lt |
| Base Domain | credit24.lt |
| Scan Status | Ok |
| Last Scan | 5/5/2025, 5:06:46 PM |
| Next Scan | 6/4/2025, 5:06:46 PM |
Last Scan
| Scanned | 5/5/2025, 5:06:46 PM |
| URL | https://credit24.lt/robots.txt |
| Domain IPs | 192.230.77.144, 192.230.78.144 |
| Response IP | 192.230.78.144 |
| Found | Yes |
| Hash | 6592044fb033d5d4dbfe64e9322c13258f5f5f8927ebe23f89cca2e2a4c488bc |
| SimHash | fb3931e703e7 |
Groups
*
| Rule | Path |
|---|---|
| Allow | / |
| Disallow | /.htaccess |
| Disallow | /cgi-bin/$ |
| Allow | /*.js |
| Allow | /*.css |
| Allow | *.css$ |
| Allow | *.js$ |
| Allow | *.html$ |
| Allow | *.htm$ |
| Allow | *.doc$ |
| Allow | *.docx$ |
| Allow | *.xls$ |
| Allow | *.xlt$ |
| Allow | *.xlsx$ |
| Allow | *.pp$ |
| Allow | *.sldx$ |
| Allow | *.pub$ |
| Allow | *.inc$ |
| Allow | *.wmv$ |
| Allow | *.gif$ |
| Allow | *.jpg$ |
| Allow | *.jpeg$ |
| Allow | *.pdf$ |
| Allow | *.png$ |
| Allow | *.wmv$ |
| Allow | *.tar$ |
| Allow | *.gz$ |
| Allow | *.tar$ |
| Allow | *.gz.tar$ |
| Allow | *.zip$ |
| Allow | *.xml$ |
| Disallow | *.php$ |
| Disallow | *.*.php$ |
| Disallow | *.pdf$ |
| Disallow | /readme.html |
| Disallow | /readme.md |
| Disallow | /license.txt |
| Disallow | /license.md |
| Disallow | /lt/n/ |
Other Records
| Field | Value |
|---|---|
| sitemap | https://credit24.lt/sitemap.xml |
Warnings
- 4 invalid lines.
Comments