maghress.com
robots.txt
Robots Exclusion Standard data for maghress.com
Resource Scan
Scan Details
Site Domain | maghress.com |
Base Domain | maghress.com |
Scan Status | Failed |
Failure Stage | Fetching resource. |
Failure Reason | Server returned a client error. |
Last Scan | 2024-06-13T23:15:53+00:00 |
Next Scan | 2024-07-13T23:15:53+00:00 |
Last Successful Scan
Scanned | 2024-05-15T18:32:42+00:00 |
URL | https://maghress.com/robots.txt |
Redirect | https://www.maghress.com/robots.txt |
Redirect Domain | www.maghress.com |
Redirect Base | maghress.com |
Domain IPs | 104.21.81.244, 172.67.192.33, 2606:4700:3030::ac43:c021, 2606:4700:3037::6815:51f4 |
Redirect IPs | 104.21.81.244, 172.67.192.33, 2606:4700:3030::ac43:c021, 2606:4700:3037::6815:51f4 |
Response IP | 104.21.81.244 |
Found | Yes |
Hash | f462415e675bcb50a0dd5f5e32a76675b07e17a93d19e85d45c28d32e7ad2d65 |
SimHash | a04c5b7067d3 |
Groups
*
Rule | Path |
---|---|
Disallow | /faces/*.xhtml |
Disallow | */rss |
Disallow | /waitlist |
Disallow | /search/%D8%AE%D8%A7%D9%84%D8%AF%2B%D8%A7%D9%84%D8%B9%D9%84%D9%85%D9%8A%2B%D9%8A%D9%87%D8%B1%D8%A8%2B%D9%85%D9%86%2B%D8%AD%D9%83%D9%85%2B%2B%D8%B3%D9%86%D9%88%D8%A7%D8%AA%2B%D8%A8%D8%B3%D8%A8%D8%A8%2B%D8%B4%D9%8A%D9%83%2B%D8%A8%D8%AF%D9%88%D9%86%2B%D8%B1%D8%B5%D9%8A%D8%AF |
Disallow | /search/%D8%AE%D8%A7%D9%84%D8%AF%2B%D8%A7%D9%84%D8%B9%D9%84%D9%85%D9%8A%2B%D9%8A%D9%87%D8%B1%D8%A8%2B%D9%85%D9%86%2B%D8%AD%D9%83%D9%85%2B%2B%D8%B3%D9%86%D9%88%D8%A7%D8%AA%2B%D8%A8%D8%B3%D8%A8%D8%A8%2B%D8%B4%D9%8A%D9%83%2B%D8%A8%D8%AF%D9%88%D9%86%2B%D8%B1%D8%B5%D9%8A%D8%AF |