safar.sd
robots.txt
Robots Exclusion Standard data for safar.sd
Resource Scan
Scan Details
Site Domain | safar.sd |
Base Domain | safar.sd |
Scan Status | Failed |
Failure Stage | Fetching resource. |
Failure Reason | Server returned a server error. |
Last Scan | 2024-09-14T19:00:25+00:00 |
Next Scan | 2024-12-13T19:00:25+00:00 |
Last Successful Scan
Scanned | 2022-11-23T20:13:30+00:00 |
URL | https://www.safar.sd/robots.txt |
Response IP | 52.12.198.95, 100.21.184.71, 35.155.25.163 |
Found | Yes |
Hash | 45acfecfac64b3fc8c5ebd70a98250c044de7659ba9930335c65f9bb1eb0ee13 |
SimHash | 49081a608e31 |
Groups
*
Rule | Path |
---|---|
Disallow | /search?updated-min= |
Disallow | /search?updated-max= |
Disallow | /search/label/*?updated-min= |
Disallow | /search/label/*?updated-max= |
Allow | / |
Other Records
Field | Value |
---|---|
sitemap | https://www.safar.sd/sitemap.xml |