algeriedeals.com
robots.txt
Robots Exclusion Standard data for algeriedeals.com
Resource Scan
Scan Details
Site Domain | algeriedeals.com |
Base Domain | algeriedeals.com |
Scan Status | Failed |
Failure Stage | Fetching resource. |
Failure Reason | Server returned a client error. |
Last Scan | 2024-08-11T05:56:50+00:00 |
Next Scan | 2024-11-09T05:56:50+00:00 |
Last Successful Scan
Scanned | 2023-10-17T05:28:17+00:00 |
URL | https://algeriedeals.com/robots.txt |
Domain IPs | 104.21.55.125, 172.67.148.28, 2606:4700:3033::6815:377d, 2606:4700:3034::ac43:941c |
Response IP | 172.67.148.28 |
Found | Yes |
Hash | d8df28b8155eef7ebc819e1b3fc868a64ef5629234d6da839385dc7c0126524d |
SimHash | 2a4f50904f05 |
Groups
*
Rule | Path |
---|---|
Disallow | /wp-content/ |
Disallow | /wp-admin/ |
Disallow | /wp-includes/ |
Disallow | /wp-login.php |
Disallow | /wp-register.php |
Disallow | /cdn-cgi/ |
Disallow | *.gif$ |
Disallow | *.exe$ |
Disallow | *.zip$ |
Disallow | *.php3*$ |
Disallow | *.dll$ |
Disallow | *.xls$ |
Disallow | *w%3D%3D$ |
Disallow | *data%3A*$ |
Disallow | *base64*$ |
Disallow | *imgopt.php |
Disallow | *redir.php |
Other Records
Field | Value |
---|---|
sitemap | https://www.algeriedeals.com/sitemap.xml |
Warnings
- 4 invalid lines.