webxxx.ch
robots.txt
Robots Exclusion Standard data for webxxx.ch
Resource Scan
Scan Details
| Site Domain | webxxx.ch |
| Base Domain | webxxx.ch |
| Scan Status | Ok |
| Last Scan | 2024-09-16T08:26:06+00:00 |
| Next Scan | 2024-10-16T08:26:06+00:00 |
Last Scan
| Scanned | 2024-09-16T08:26:06+00:00 |
| URL | https://webxxx.ch/robots.txt |
| Redirect | http://www.webxxx.ch/robots.txt |
| Redirect Domain | www.webxxx.ch |
| Redirect Base | webxxx.ch |
| Domain IPs | 104.21.1.185, 172.67.129.198 |
| Redirect IPs | 104.21.1.185, 172.67.129.198 |
| Response IP | 104.21.1.185 |
| Found | Yes |
| Hash | a32ffed03e57ee8424b466894ef3c003b9c5bdb502e322b101287452652a3783 |
| SimHash | a5db5dc24e25 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /inserat/d14 |
| Disallow | /inserat/premium |
| Disallow | /inserat/standard |
| Disallow | /inserat/gratis |
| Disallow | /inserat/d7 |
| Disallow | /account/ |
| Disallow | /de/inserat/d14 |
| Disallow | /de/inserat/premium |
| Disallow | /de/inserat/standard |
| Disallow | /de/inserat/gratis |
| Disallow | /de/inserat/d7 |
| Disallow | /de/account/ |
| Disallow | /en/inserat/d14 |
| Disallow | /en/inserat/premium |
| Disallow | /en/inserat/standard |
| Disallow | /en/inserat/gratis |
| Disallow | /en/inserat/d7 |
| Disallow | /en/account/ |
| Disallow | /fr/inserat/d14 |
| Disallow | /fr/inserat/premium |
| Disallow | /fr/inserat/standard |
| Disallow | /fr/inserat/gratis |
| Disallow | /fr/inserat/d7 |
| Disallow | /fr/account/ |
| Disallow | /hu/inserat/d14 |
| Disallow | /hu/inserat/premium |
| Disallow | /hu/inserat/standard |
| Disallow | /hu/inserat/gratis |
| Disallow | /hu/inserat/d7 |
| Disallow | /hu/account/ |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 30 |