memur5.com
robots.txt
Robots Exclusion Standard data for memur5.com
Resource Scan
Scan Details
| Site Domain | memur5.com |
| Base Domain | memur5.com |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Server returned a client error. |
| Last Scan | 2025-09-08T08:35:46+00:00 |
| Next Scan | 2025-10-08T08:35:46+00:00 |
Last Successful Scan
| Scanned | 2025-08-10T05:57:47+00:00 |
| URL | https://memur5.com/robots.txt |
| Redirect | https://www.memur5.com/robots.txt |
| Redirect Domain | www.memur5.com |
| Redirect Base | memur5.com |
| Domain IPs | 104.21.1.138, 172.67.129.102, 2606:4700:3033::6815:18a, 2606:4700:3036::ac43:8166 |
| Redirect IPs | 104.21.1.138, 172.67.129.102, 2606:4700:3033::6815:18a, 2606:4700:3036::ac43:8166 |
| Response IP | 172.67.129.102 |
| Found | Yes |
| Hash | 1f6787d41594565e88038371ece78bf25f21b20eca13e1fa7905371d93139b40 |
| SimHash | 34112cc5c991 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /haber-gundemi/ |
| Disallow | /arama/* |
| Disallow | /arsiv/* |
| Disallow | /reklam/* |
| Disallow | /katman/* |
| Disallow | /index.php |
| Disallow | /index.php/* |
| Disallow | /anasayfa |
| Disallow | /*?page* |
| Disallow | /*?q= |
| Disallow | /*?preview= |
| Disallow | /*?utm_source= |
| Disallow | /*?ref= |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.memur5.com/sitemap_google_news.xml |
| sitemap | https://www.memur5.com/sitemap_posts.xml |