dating.classicfm.co.uk
robots.txt
Robots Exclusion Standard data for dating.classicfm.co.uk
Resource Scan
Scan Details
Site Domain | dating.classicfm.co.uk |
Base Domain | classicfm.co.uk |
Scan Status | Failed |
Failure Stage | Fetching resource. |
Failure Reason | Server returned a client error. |
Last Scan | 2024-06-08T21:12:33+00:00 |
Next Scan | 2024-07-08T21:12:33+00:00 |
Last Successful Scan
Scanned | 2024-05-10T21:06:24+00:00 |
URL | https://dating.classicfm.co.uk/robots.txt |
Domain IPs | 212.32.224.182 |
Response IP | 212.32.224.182 |
Found | Yes |
Hash | e59c2b5104b1d4607cb9ea4be838d497d43e2d06bbffca0106dfb57644e4612e |
SimHash | d9609f101f32 |
Groups
*
Rule | Path |
---|---|
Disallow | /ads/ |
Disallow | /maintenance.html |
Disallow | /s/a/ |
Disallow | /s/admin/ |
Disallow | /s/afw/ |
Disallow | /s/CatnipForNaughtyRobots |
Disallow | /s/find/block.php? |
Disallow | /s/find/favourites.php? |
Disallow | /s/find/photos.php? |
Disallow | /s/find/tell.php? |
Disallow | /s/mail/write.php |
Disallow | /s/profile/base.php |
Disallow | /s/a?setLang=de |
Disallow | /s/a?setLang=nl |
Disallow | /s/*?c= |
Disallow | /s/*?m= |
Disallow | /s/a/affiliates/ |
Other Records
Field | Value |
---|---|
sitemap | https://dating.classicfm.co.uk/s/i2_6_dictionary.xml |