giftgen.co.uk
robots.txt
Robots Exclusion Standard data for giftgen.co.uk
Resource Scan
Scan Details
| Site Domain | giftgen.co.uk |
| Base Domain | giftgen.co.uk |
| Scan Status | Ok |
| Last Scan | 2024-05-27T23:34:18+00:00 |
| Next Scan | 2024-06-26T23:34:18+00:00 |
Last Scan
| Scanned | 2024-05-27T23:34:18+00:00 |
| URL | https://giftgen.co.uk/robots.txt |
| Redirect | https://www.giftgen.co.uk/robots.txt |
| Redirect Domain | www.giftgen.co.uk |
| Redirect Base | giftgen.co.uk |
| Domain IPs | 2001:8d8:100f:f000::2fb, 217.160.0.90 |
| Redirect IPs | 2001:8d8:100f:f000::2fb, 217.160.0.90 |
| Response IP | 217.160.0.90 |
| Found | Yes |
| Hash | b78e1802023210d411d802dc8232f363080a1b166b450b53a00fd01a18b2bb96 |
| SimHash | 20114c96c3b5 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /pda-results.php |
| Disallow | /validator/ |
| Disallow | /admin/ |
| Disallow | /results.php |
| Disallow | /gift-ideas// |
| Disallow | /gift-ideas/0 |
| Disallow | /gift-ideas/1 |
| Disallow | /gift-ideas/2 |
| Disallow | /gift-ideas/3 |
| Disallow | /gift-ideas/4 |
| Disallow | /gift-ideas/5-7_years/ |
| Disallow | /gift-ideas/ann../ |
| Disallow | /gift-ideas/bir../ |
| Disallow | /gift-ideas/chr../ |
| Disallow | /gift-ideas/fem../ |
| Disallow | /gift-ideas/mal../ |