merruk.com
robots.txt
Robots Exclusion Standard data for merruk.com
Resource Scan
Scan Details
Site Domain | merruk.com |
Base Domain | merruk.com |
Scan Status | Failed |
Failure Stage | Fetching resource. |
Failure Reason | Server returned a server error. |
Last Scan | 2024-09-02T18:25:31+00:00 |
Next Scan | 2024-11-01T18:25:31+00:00 |
Last Successful Scan
Scanned | 2024-07-05T18:24:48+00:00 |
URL | https://merruk.com/robots.txt |
Redirect | https://www.merruk.com/robots.txt |
Redirect Domain | www.merruk.com |
Redirect Base | merruk.com |
Domain IPs | 104.21.76.155, 172.67.197.43, 2606:4700:3032::6815:4c9b, 2606:4700:3032::ac43:c52b |
Redirect IPs | 104.21.76.155, 172.67.197.43, 2606:4700:3032::6815:4c9b, 2606:4700:3032::ac43:c52b |
Response IP | 172.67.197.43 |
Found | Yes |
Hash | e5c15cb9c67731c5f4dd54b3db83d830b76f82cbf63d86a4e41d59de184cb173 |
SimHash | ab4dcc300011 |
Groups
*
Rule | Path |
---|---|
Allow | / |
Allow | /ror.xml |
Allow | /urllist.txt |
Allow | /sitemap.xml |
Allow | /sitemap.xml.gz |
Allow | /imagesitemap.xml |
Allow | /videositemap.xml |
Allow | /rss.xml |
Allow | /opensearch.xml |
Allow | /atom.xml |
Disallow | /administrator/ |
Disallow | /cache/ |
Disallow | /components/ |
Disallow | /includes/ |
Disallow | /installation/ |
Disallow | /language/ |
Disallow | /libraries/ |
Disallow | /media/ |
Disallow | /modules/ |
Disallow | /plugins/ |
Disallow | /templates/ |
Disallow | /tmp/ |
Disallow | /xmlrpc/ |
Other Records
Field | Value |
---|---|
sitemap | https://www.merruk.ma/sitemap.xml |