cougar-dates.co.uk
robots.txt
Robots Exclusion Standard data for cougar-dates.co.uk
Resource Scan
Scan Details
| Site Domain | cougar-dates.co.uk |
| Base Domain | cougar-dates.co.uk |
| Scan Status | Ok |
| Last Scan | 2024-06-03T01:04:39+00:00 |
| Next Scan | 2024-07-03T01:04:39+00:00 |
Last Scan
| Scanned | 2024-06-03T01:04:39+00:00 |
| URL | https://cougar-dates.co.uk/robots.txt |
| Redirect | https://www.cougar-dates.co.uk/robots.txt |
| Redirect Domain | www.cougar-dates.co.uk |
| Redirect Base | cougar-dates.co.uk |
| Domain IPs | 104.21.86.198, 172.67.136.153, 2606:4700:3036::6815:56c6, 2606:4700:3036::ac43:8899 |
| Redirect IPs | 104.21.86.198, 172.67.136.153, 2606:4700:3036::6815:56c6, 2606:4700:3036::ac43:8899 |
| Response IP | 104.21.86.198 |
| Found | Yes |
| Hash | ef701db02c4636831975711a766ff74efd008e1638229749d8ab2602e432d5e8 |
| SimHash | 6c16fc27f716 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /members/ |
| Disallow | /faq/ |
| Disallow | /faq.xhtml |
| Disallow | /about/ |
| Disallow | /about.xhtml |
| Disallow | /terms/ |
| Disallow | /terms.xhtml |
| Disallow | /privacy/ |
| Disallow | /try/ |
| Disallow | /privacy.xhtml |
| Disallow | /contacts/ |
| Disallow | /impressum |
| Disallow | /tutorials/record_photos_and_videos_from_your_webcam |
| Disallow | /usc |
| Disallow | /cookie |
| Disallow | /dating_tips_index |
| Disallow | /terms.de |
| Disallow | /alicampbellbook |
| Disallow | /payment/membership_terms/3_Days_Gold |
| Disallow | /payment/membership_terms/3_Days_Gold_3Months |
| Disallow | /video |
| Disallow | /unsubscribe |
| Disallow | /ageVerification |
| Disallow | /apps/index |
| Disallow | /apps/bestMatch |
| Disallow | /external/ |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 1 |
yandex
| Rule | Path |
|---|---|
| Disallow | /members/ |
| Disallow | /faq/ |
| Disallow | /faq.xhtml |
| Disallow | /about/ |
| Disallow | /about.xhtml |
| Disallow | /terms/ |
| Disallow | /terms.xhtml |
| Disallow | /privacy/ |
| Disallow | /privacy.xhtml |
| Disallow | /contacts/ |
| Disallow | /impressum |
| Disallow | /tutorials/record_photos_and_videos_from_your_webcam |
| Disallow | /usc |
| Disallow | /cookie |
| Disallow | /dating_tips_index |
| Disallow | /terms.de |
| Disallow | /alicampbellbook |
| Disallow | /payment/membership_terms/3_Days_Gold |
| Disallow | /payment/membership_terms/3_Days_Gold_3Months |
| Disallow | /video |
| Disallow | /unsubscribe |
| Disallow | /ageVerification |
| Disallow | /apps/index |
| Disallow | /apps/bestMatch |
| Disallow | /external/ |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 1 |
Warnings
- `clean-param` is not a known field.