wikimatome.org
robots.txt
Robots Exclusion Standard data for wikimatome.org
Resource Scan
Scan Details
| Site Domain | wikimatome.org |
| Base Domain | wikimatome.org |
| Scan Status | Ok |
| Last Scan | 2025-08-30T19:23:57+00:00 |
| Next Scan | 2025-09-29T19:23:57+00:00 |
Last Scan
| Scanned | 2025-08-30T19:23:57+00:00 |
| URL | https://wikimatome.org/robots.txt |
| Domain IPs | 104.21.43.138, 172.67.180.49, 2606:4700:3030::ac43:b431, 2606:4700:3037::6815:2b8a |
| Response IP | 104.21.43.138 |
| Found | Yes |
| Hash | 1d6612fe0efe50739965d12fdeff25a454bce25cbef9e23e89a8e3c30594a50f |
| SimHash | 4f549672cf36 |
Groups
*
| Rule | Path |
|---|---|
| Allow | / |
| Disallow | /*.json$ |
| Disallow | /*.xml$ |
| Disallow | /*?* |
| Allow | /assets/ |
| Allow | *.css |
| Allow | *.js |
| Allow | *.png |
| Allow | *.jpg |
| Allow | *.jpeg |
| Allow | *.webp |
| Allow | *.gif |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 1 |
Other Records
| Field | Value |
|---|---|
| sitemap | https://wikimatome.org/sitemap.xml |
Comments