cegos.com
robots.txt
Robots Exclusion Standard data for cegos.com
Resource Scan
Scan Details
| Site Domain | cegos.com |
| Base Domain | cegos.com |
| Scan Status | Ok |
| Last Scan | 2024-11-16T07:36:21+00:00 |
| Next Scan | 2024-12-16T07:36:21+00:00 |
Last Scan
| Scanned | 2024-11-16T07:36:21+00:00 |
| URL | https://www.cegos.com/robots.txt |
| Domain IPs | 108.156.133.103, 108.156.133.104, 108.156.133.9, 108.156.133.91, 2600:9000:2755:1e00:1c:1f9:7840:93a1, 2600:9000:2755:2a00:1c:1f9:7840:93a1, 2600:9000:2755:3800:1c:1f9:7840:93a1, 2600:9000:2755:4c00:1c:1f9:7840:93a1, 2600:9000:2755:5600:1c:1f9:7840:93a1, 2600:9000:2755:d200:1c:1f9:7840:93a1, 2600:9000:2755:d400:1c:1f9:7840:93a1, 2600:9000:2755:d600:1c:1f9:7840:93a1 |
| Response IP | 108.156.133.91 |
| Found | Yes |
| Hash | c0412b5a7a883c424da8284feb4b88574b16590a991f8fa523f4e1219139ec4b |
| SimHash | 84010c96d353 |
Groups
*
| Rule | Path |
|---|---|
| Allow | / |
| Disallow | /contact?* |
| Disallow | /contact-diplo?* |
| Disallow | /search?q=* |
| Disallow | /*?city=* |
| Disallow | /*?frompage=* |
| Disallow | /*?mid=* |
| Disallow | /*?origin=* |
| Disallow | /*?year=* |
| Disallow | /*_ga%3D* |
| Disallow | /*gclid%3D* |
| Disallow | /*productid%3D* |
| Disallow | /*utm_* |
| Disallow | /*xtor%3D* |
| Disallow | /ajax/get-new-csrf-token?_=* |
| Disallow | /*?q=* |