qnews.com.au
robots.txt
Robots Exclusion Standard data for qnews.com.au
Resource Scan
Scan Details
Site Domain | qnews.com.au |
Base Domain | qnews.com.au |
Scan Status | Failed |
Failure Stage | Fetching resource. |
Failure Reason | Server returned a client error. |
Last Scan | 2024-09-27T10:39:41+00:00 |
Next Scan | 2024-10-04T10:39:41+00:00 |
Last Successful Scan
Scanned | 2024-08-15T06:09:14+00:00 |
URL | https://qnews.com.au/robots.txt |
Domain IPs | 34.149.120.3, 34.149.36.179, 35.190.31.54, 35.227.194.51 |
Response IP | 35.190.31.54 |
Found | Yes |
Hash | a3e9401a3e0829f235cdae38782efbe38460434ca125460c11dabd391d3e25b8 |
SimHash | d96dccc0a41b |
Groups
*
Rule | Path |
---|---|
Disallow | /?s= |
Disallow | /page/*/?s= |
Disallow | /search/ |
Disallow | /wp-json/ |
Disallow | /?rest_route= |
Other Records
Field | Value |
---|---|
sitemap | https://qnews.com.au/sitemap_index.xml |
Comments