sahboud.com
robots.txt
Robots Exclusion Standard data for sahboud.com
Resource Scan
Scan Details
Site Domain | sahboud.com |
Base Domain | sahboud.com |
Scan Status | Ok |
Last Scan | 2025-05-15T17:30:51+00:00 |
Next Scan | 2025-05-29T17:30:51+00:00 |
Last Scan
Scanned | 2025-05-15T17:30:51+00:00 |
URL | https://sahboud.com/robots.txt |
Domain IPs | 104.21.55.3, 172.67.143.194, 2606:4700:3033::ac43:8fc2, 2606:4700:3035::6815:3703 |
Response IP | 172.67.143.194 |
Found | Yes |
Hash | 6d203e0decee43f0574c52b4a7d2f06adb8819e4b3137bf9d4aa061422e9ed56 |
SimHash | 634767730ba7 |
Groups
*
No rules defined. All paths allowed.
Other Records
Field | Value |
---|---|
crawl-delay | 10 |
*
Rule | Path |
---|---|
Disallow | /admin/ |
Disallow | /private/ |
Disallow | /hidden.html/ |
Disallow | /cgi-bin/ |
Allow | /public/ |
Allow | /images/ |
Disallow | /checkout/ |
Disallow | /cart/ |
Disallow | /login/ |
Disallow | /register/ |
Disallow | /user/ |
Disallow | /*/p*?page=* |
Disallow | /*/page-*?page=* |
Disallow | /cart |
Disallow | */redirect |
Other Records
Field | Value |
---|---|
sitemap | https://sahboud.com/ar/sitemap.xml |
Warnings
- 10 invalid lines.