cleber.md
robots.txt
Robots Exclusion Standard data for cleber.md
Resource Scan
Scan Details
| Site Domain | cleber.md |
| Base Domain | cleber.md |
| Scan Status | Ok |
| Last Scan | 2025-10-01T09:47:47+00:00 |
| Next Scan | 2025-10-08T09:47:47+00:00 |
Last Scan
| Scanned | 2025-10-01T09:47:47+00:00 |
| URL | https://cleber.md/robots.txt |
| Domain IPs | 185.181.229.190 |
| Response IP | 185.181.229.190 |
| Found | Yes |
| Hash | e84d6fb9764a369037a4c2d68407cce8e440b9817ff957e587191a02ffa48922 |
| SimHash | 6089aa721ab8 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /*?* |
| Disallow | /*php |
| Disallow | /cgi-bin |
| Disallow | /wp-json |
| Disallow | */feed |
| Disallow | /wp- |
| Disallow | */comments |
| Disallow | */trackback |
| Allow | /wp-admin/admin-ajax.php |
| Allow | */uploads |
| Allow | /*/*.js |
| Allow | /*/*.css |
| Allow | /wp-*.png |
| Allow | /wp-*.jpg |
| Allow | /wp-*.jpeg |
| Allow | /wp-*.gif |
Other Records
| Field | Value |
|---|---|
| sitemap | https://cleber.md/sitemap_index.xml |
Warnings
- `host` is not a known field.