cegos.fr
robots.txt
Robots Exclusion Standard data for cegos.fr
Resource Scan
Scan Details
| Site Domain | cegos.fr |
| Base Domain | cegos.fr |
| Scan Status | Ok |
| Last Scan | 2024-05-16T06:49:10+00:00 |
| Next Scan | 2024-06-15T06:49:10+00:00 |
Last Scan
| Scanned | 2024-05-16T06:49:10+00:00 |
| URL | https://cegos.fr/robots.txt |
| Redirect | https://www.cegos.fr/robots.txt |
| Redirect Domain | www.cegos.fr |
| Redirect Base | cegos.fr |
| Domain IPs | 217.70.184.55 |
| Redirect IPs | 108.156.133.129, 108.156.133.38, 108.156.133.72, 108.156.133.78, 2600:9000:2755:1400:d:3b0e:3c00:93a1, 2600:9000:2755:1a00:d:3b0e:3c00:93a1, 2600:9000:2755:400:d:3b0e:3c00:93a1, 2600:9000:2755:5600:d:3b0e:3c00:93a1, 2600:9000:2755:9400:d:3b0e:3c00:93a1, 2600:9000:2755:a600:d:3b0e:3c00:93a1, 2600:9000:2755:da00:d:3b0e:3c00:93a1, 2600:9000:2755:f200:d:3b0e:3c00:93a1 |
| Response IP | 108.156.133.78 |
| Found | Yes |
| Hash | 08b29b9656c538645aa6d0527fbf7b843a4b2670677a6fc61f27c62bb8a775ba |
| SimHash | c5158c9353d2 |
Groups
*
| Rule | Path |
|---|---|
| Allow | / |
| Disallow | /contact-diplo?* |
| Disallow | /*?city=* |
| Disallow | /*?frompage=* |
| Disallow | /*?mid=* |
| Disallow | /*?year=* |
| Disallow | /*_ga%3D* |
| Disallow | /*gclid%3D* |
| Disallow | /*productid%3D* |
| Disallow | /*utm_* |
| Disallow | /*xtor%3D* |
| Disallow | /ajax/get-new-csrf-token?_=* |
| Disallow | /*?q=* |
| Disallow | /*?refProduct=* |