ukrfootball.ua
robots.txt
Robots Exclusion Standard data for ukrfootball.ua
Resource Scan
Scan Details
Site Domain | ukrfootball.ua |
Base Domain | ukrfootball.ua |
Scan Status | Failed |
Failure Stage | Fetching resource. |
Failure Reason | Server returned a client error. |
Last Scan | 2024-05-06T07:50:49+00:00 |
Next Scan | 2024-08-04T07:50:49+00:00 |
Last Successful Scan
Scanned | 2023-07-12T07:49:04+00:00 |
URL | https://ukrfootball.ua/robots.txt |
Domain IPs | 104.21.42.92, 172.67.160.118, 2606:4700:3033::ac43:a076, 2606:4700:3036::6815:2a5c |
Response IP | 172.67.160.118 |
Found | Yes |
Hash | e4bcd66a7c06b93583eadb3965ce029deb99326c2df1879b0613d3877310d633 |
SimHash | 45401901f533 |
Groups
*
Rule | Path |
---|---|
Disallow | /sign-in/ |
Disallow | /sign-out/ |
Disallow | /verify-email/ |
Disallow | /forgot-password/ |
Disallow | /change-password/ |
Disallow | /search/?term* |
Disallow | /json/ |
Disallow | /go/ |
Disallow | /*admin/ |
Disallow | /*_openstat |
Disallow | /*from%3Dadwords |
Disallow | /*utm_source* |
Disallow | /*gclid%3D |
Disallow | /*cf_chl_captcha* |
Allow | /rss.xml |
Other Records
Field | Value |
---|---|
sitemap | https://ukrfootball.ua/sitemap.xml |
sitemap | https://ukrfootball.ua/sitemap.news.xml |
Warnings
- `host` is not a known field.