mavyret.com
robots.txt
Robots Exclusion Standard data for mavyret.com
Resource Scan
Scan Details
Site Domain | mavyret.com |
Base Domain | mavyret.com |
Scan Status | Ok |
Last Scan | 2024-05-11T09:20:57+00:00 |
Next Scan | 2024-06-10T09:20:57+00:00 |
Last Scan
Scanned | 2024-05-11T09:20:57+00:00 |
URL | https://mavyret.com/robots.txt |
Redirect | https://www.mavyret.com/robots.txt |
Redirect Domain | www.mavyret.com |
Redirect Base | mavyret.com |
Domain IPs | 159.180.132.176 |
Redirect IPs | 13.35.18.111, 13.35.18.117, 13.35.18.89, 13.35.18.98, 2600:9000:20c7:1400:5:8ced:94c0:93a1, 2600:9000:20c7:1800:5:8ced:94c0:93a1, 2600:9000:20c7:3a00:5:8ced:94c0:93a1, 2600:9000:20c7:4e00:5:8ced:94c0:93a1, 2600:9000:20c7:8800:5:8ced:94c0:93a1, 2600:9000:20c7:a000:5:8ced:94c0:93a1, 2600:9000:20c7:a00:5:8ced:94c0:93a1, 2600:9000:20c7:dc00:5:8ced:94c0:93a1 |
Response IP | 13.35.18.98 |
Found | Yes |
Hash | 3b7996f4bcb4671a11c92d0170b4c9df0e39a14759422b4d4ee114e98b40e16d |
SimHash | 275a9d0f7fc1 |
Groups
*
Rule | Path |
---|---|
Disallow | /search-results* |
Disallow | /page-not-found* |
Disallow | /system-error* |
Disallow | /jcr* |
Disallow | /generatepdf* |
Disallow | /api/* |
Disallow | /thank-you* |
Disallow | /content/usergenerated/content/forms/af/* |
Other Records
Field | Value |
---|---|
sitemap | https://www.mavyret.com/sitemap.xml |
sitemap | https://www.mavyret.com/image-sitemap.xml |
sitemap | https://www.mavyret.com/video-sitemap.xml |
Comments