mavyret.com
robots.txt

Robots Exclusion Standard data for mavyret.com

Resource Scan

Scan Details

Site Domain mavyret.com
Base Domain mavyret.com
Scan Status Ok
Last Scan2024-05-11T09:20:57+00:00
Next Scan 2024-06-10T09:20:57+00:00

Last Scan

Scanned2024-05-11T09:20:57+00:00
URL https://mavyret.com/robots.txt
Redirect https://www.mavyret.com/robots.txt
Redirect Domain www.mavyret.com
Redirect Base mavyret.com
Domain IPs 159.180.132.176
Redirect IPs 13.35.18.111, 13.35.18.117, 13.35.18.89, 13.35.18.98, 2600:9000:20c7:1400:5:8ced:94c0:93a1, 2600:9000:20c7:1800:5:8ced:94c0:93a1, 2600:9000:20c7:3a00:5:8ced:94c0:93a1, 2600:9000:20c7:4e00:5:8ced:94c0:93a1, 2600:9000:20c7:8800:5:8ced:94c0:93a1, 2600:9000:20c7:a000:5:8ced:94c0:93a1, 2600:9000:20c7:a00:5:8ced:94c0:93a1, 2600:9000:20c7:dc00:5:8ced:94c0:93a1
Response IP 13.35.18.98
Found Yes
Hash 3b7996f4bcb4671a11c92d0170b4c9df0e39a14759422b4d4ee114e98b40e16d
SimHash 275a9d0f7fc1

Groups

*

Rule Path
Disallow /search-results*
Disallow /page-not-found*
Disallow /system-error*
Disallow /jcr*
Disallow /generatepdf*
Disallow /api/*
Disallow /thank-you*
Disallow /content/usergenerated/content/forms/af/*

Other Records

Field Value
sitemap https://www.mavyret.com/sitemap.xml
sitemap https://www.mavyret.com/image-sitemap.xml
sitemap https://www.mavyret.com/video-sitemap.xml

Comments

  • Ivy Robots file to be renamed as robots.txt