batemansbaypost.com.au
robots.txt
Robots Exclusion Standard data for batemansbaypost.com.au
Resource Scan
Scan Details
Site Domain | batemansbaypost.com.au |
Base Domain | batemansbaypost.com.au |
Scan Status | Ok |
Last Scan | 2024-07-13T09:37:15+00:00 |
Next Scan | 2024-07-20T09:37:15+00:00 |
Last Scan
Scanned | 2024-07-13T09:37:15+00:00 |
URL | https://batemansbaypost.com.au/robots.txt |
Redirect | https://www.batemansbaypost.com.au/robots.txt |
Redirect Domain | www.batemansbaypost.com.au |
Redirect Base | batemansbaypost.com.au |
Domain IPs | 54.230.71.121, 54.230.71.21, 54.230.71.26, 54.230.71.63 |
Redirect IPs | 54.230.71.102, 54.230.71.40, 54.230.71.54, 54.230.71.70 |
Response IP | 108.157.254.70 |
Found | Yes |
Hash | 7c2f3ab2695680af225ef509432aba4af9a07372e92a8ff4a6e762c9ef18c9c3 |
SimHash | 4564b591ecf5 |
Groups
*
Rule | Path |
---|---|
Disallow | /*/ajax/ |
Disallow | /*/ajax |
Disallow | /*/internal/ |
Disallow | /push-worker.js |
Disallow | /scores-and-draws/ |
Disallow | */rss.xml |
Disallow | */rss-full.xml |
Disallow | */feed |
Disallow | */feed/ |
Other Records
Field | Value |
---|---|
sitemap | https://www.batemansbaypost.com.au/sitemap.xml |
sitemap | https://www.batemansbaypost.com.au/sitemap-news.xml |
Comments