matovsky.com
robots.txt
Robots Exclusion Standard data for matovsky.com
Resource Scan
Scan Details
| Site Domain | matovsky.com |
| Base Domain | matovsky.com |
| Scan Status | Ok |
| Last Scan | 2024-10-30T08:19:13+00:00 |
| Next Scan | 2024-11-06T08:19:13+00:00 |
Last Scan
| Scanned | 2024-10-30T08:19:13+00:00 |
| URL | https://matovsky.com/robots.txt |
| Domain IPs | 104.21.60.3, 172.67.186.162 |
| Response IP | 172.67.186.162 |
| Found | Yes |
| Hash | 3e59a82caa4dea82926847b723c6f8cc2266fc5bc4aa5805b94a551ba789fec2 |
| SimHash | 0132dcfdc731 |
Groups
*
| Rule | Path |
|---|---|
| Allow | / |
| Disallow | /contact-en |
| Disallow | /contact-ru |
| Disallow | /contact-cn |
| Disallow | /contact-tw |
| Disallow | /project-type/* |
| Disallow | /project-tag/* |
| Disallow | /xmlrpc.php?rsd |
| Disallow | /wp-includes/wlwmanifest.xml |
| Disallow | /archives/ |
| Disallow | /author/ |
| Disallow | /tag/ |
| Disallow | /wp-json/ |
| Disallow | /search/ |
| Disallow | /photo/ |
| Disallow | /upload/ |
| Disallow | /bodybuilding/ |
| Disallow | /business/ |
| Disallow | /computer/ |
| Disallow | /health/ |
| Disallow | /psychology/ |
| Disallow | /user/ |
| Disallow | /registration/ |
| Disallow | /tender/ |
| Disallow | /photo/211/ |
| Disallow | /map.html |
| Disallow | /training-failure-overtraining.html |
| Disallow | /fst-7-workout-program.html |
| Disallow | /powerlifter-vs-calisthenics-street-workout.html |
| Disallow | /*/*?sphrase_id=* |
| Disallow | /*/*?PAGEN_* |
| Disallow | /*/*?epl=* |
| Disallow | /*?sphrase_id=* |
| Disallow | /*?PAGEN_* |
| Disallow | /*?epl=* |
| Disallow | /?sphrase_id=* |
| Disallow | /?PAGEN_* |
| Disallow | /?epl=* |
| Disallow | /?blackhole |
| Disallow | /?wysijap* |
| Disallow | /?wysija-page* |
| Disallow | /XML-Generator* |
| Disallow | *?nonamp=1 |
Other Records
| Field | Value |
|---|---|
| sitemap | https://matovsky.com/sitemap.xml |
Warnings
- `host` is not a known field.