qldtoday.com
robots.txt
Robots Exclusion Standard data for qldtoday.com
Resource Scan
Scan Details
Site Domain | qldtoday.com |
Base Domain | qldtoday.com |
Scan Status | Ok |
Last Scan | 2024-11-11T21:43:13+00:00 |
Next Scan | 2024-11-18T21:43:13+00:00 |
Last Scan
Scanned | 2024-11-11T21:43:13+00:00 |
URL | https://qldtoday.com/robots.txt |
Domain IPs | 104.21.22.126, 172.67.205.8, 2606:4700:3033::ac43:cd08, 2606:4700:3034::6815:167e |
Response IP | 172.67.205.8 |
Found | Yes |
Hash | d0e7c11698119bb2f4bd8086c014475e7de5099cf43211b5952ceed8ad7c1aa7 |
SimHash | a84d4860c593 |
Groups
*
Rule | Path |
---|---|
Disallow | /*.jpg |
Disallow | /*.jpeg |
Disallow | /*.png |
Disallow | /*.gif |
Disallow | /user/ |
Disallow | /Edit/ |
Other Records
Field | Value |
---|---|
sitemap | https://cdn36.sydneytoday.com/sitemap.xml |
sitemap | https://cdn36.meltoday.com/sitemap.xml |