xxxmatch.com
robots.txt
Robots Exclusion Standard data for xxxmatch.com
Resource Scan
Scan Details
Site Domain | xxxmatch.com |
Base Domain | xxxmatch.com |
Scan Status | Ok |
Last Scan | 2024-05-14T23:07:08+00:00 |
Next Scan | 2024-06-13T23:07:08+00:00 |
Last Scan
Scanned | 2024-05-14T23:07:08+00:00 |
URL | https://xxxmatch.com/robots.txt |
Redirect | https://www.xxxmatch.com/robots.txt |
Redirect Domain | www.xxxmatch.com |
Redirect Base | xxxmatch.com |
Domain IPs | 104.18.41.205, 172.64.146.51, 2606:4700:4400::6812:29cd, 2606:4700:4400::ac40:9233 |
Redirect IPs | 104.18.41.205, 172.64.146.51, 2606:4700:4400::6812:29cd, 2606:4700:4400::ac40:9233 |
Response IP | 104.18.41.205 |
Found | Yes |
Hash | baff42236b6cb2859e7cc67129b4b6270d8107180f6f307d785411561b70dd05 |
SimHash | 4d730c03f396 |
Groups
*
Rule | Path |
---|---|
Allow | /* |
Disallow | /*.css |
Disallow | /*.js |
Disallow | /*.xml |
Disallow | /*.swf |
Disallow | /forgot_password/ |
Disallow | /custodian_of_records/ |
Disallow | /gdpr-compliance/ |
Disallow | /terms_and_conditions/ |
Disallow | /privacy/ |
Disallow | /public/ |
Disallow | /go/ |
Disallow | /ext_api/ |
Disallow | /site_map.html |
Disallow | /tour_sitemap.html |
Disallow | /dating/ |
Allow | /dating/sitemap |
Allow | /dating/*mobile* |