szabadfold.hu
robots.txt
Robots Exclusion Standard data for szabadfold.hu
Resource Scan
Scan Details
| Site Domain | szabadfold.hu |
| Base Domain | szabadfold.hu |
| Scan Status | Ok |
| Last Scan | 2024-09-21T08:31:23+00:00 |
| Next Scan | 2024-09-28T08:31:23+00:00 |
Last Scan
| Scanned | 2024-09-21T08:31:23+00:00 |
| URL | https://szabadfold.hu/robots.txt |
| Domain IPs | 104.21.72.237, 172.67.187.212, 2606:4700:3033::ac43:bbd4, 2606:4700:3034::6815:48ed |
| Response IP | 172.67.187.212 |
| Found | Yes |
| Hash | 98326d2484b2bcef8b54ede43f7bb0cbd7964fe1be5886700d667293b3a7f156 |
| SimHash | 6000c841cf13 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /kereses |
| Disallow | /hirdetesek |
| Allow | /publicapi/hu/rss/ |
| Disallow | /publicapi/ |
Other Records
| Field | Value |
|---|---|
| sitemap | https://szabadfold.hu/sitemapindex.xml |
| sitemap | https://szabadfold.hu/news_sitemap.xml |