themelocal.com
robots.txt
Robots Exclusion Standard data for themelocal.com
Resource Scan
Scan Details
| Site Domain | themelocal.com |
| Base Domain | themelocal.com |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Server returned a client error. |
| Last Scan | 2025-04-08T23:45:35+00:00 |
| Next Scan | 2025-07-07T23:45:35+00:00 |
Last Successful Scan
| Scanned | 2024-06-13T23:42:58+00:00 |
| URL | https://themelocal.com/robots.txt |
| Domain IPs | 104.21.50.204, 172.67.166.202, 2606:4700:3031::ac43:a6ca, 2606:4700:3032::6815:32cc |
| Response IP | 172.67.166.202 |
| Found | Yes |
| Hash | c4ca57e44339b2d9d410a95ba9446542c84a31e129eed0673edb83d694dce6a4 |
| SimHash | 7b1780208db0 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /wp-admin/ |
| Allow | /wp-admin/admin-ajax.php |
| Allow | /wp-admin/load-scripts.php |
| Allow | /wp-admin/load-styles.php |
| Disallow | /author/ |
| Disallow | /search |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.themelocal.com/sitemap_index.xml |
| sitemap | https://www.themelocal.com/news-sitemap.xml |
Comments