iraqdirectory.com
robots.txt
Robots Exclusion Standard data for iraqdirectory.com
Resource Scan
Scan Details
Site Domain | iraqdirectory.com |
Base Domain | iraqdirectory.com |
Scan Status | Ok |
Last Scan | 2025-05-08T06:13:34+00:00 |
Next Scan | 2025-06-07T06:13:34+00:00 |
Last Scan
Scanned | 2025-05-08T06:13:34+00:00 |
URL | https://iraqdirectory.com/robots.txt |
Domain IPs | 104.21.41.154, 172.67.148.37, 2606:4700:3031::ac43:9425, 2606:4700:3036::6815:299a |
Response IP | 172.67.148.37 |
Found | Yes |
Hash | cd43b443383b288b22102f41fad66e804699b9040babe40ccb4e2da747afa923 |
SimHash | e5091cc0c691 |
Groups
*
Rule | Path |
---|---|
Disallow | |
Disallow | /admin/ |
Disallow | /login/ |
Other Records
Field | Value |
---|---|
crawl-delay | 20 |
Other Records
Field | Value |
---|---|
sitemap | http://www.iraqdirectory.com/sitemap.xml |
Comments