bigditch.com.au
robots.txt
Robots Exclusion Standard data for bigditch.com.au
Resource Scan
Scan Details
Site Domain | bigditch.com.au |
Base Domain | bigditch.com.au |
Scan Status | Ok |
Last Scan | 2025-04-09T16:39:31+00:00 |
Next Scan | 2025-04-16T16:39:31+00:00 |
Last Scan
Scanned | 2025-04-09T16:39:31+00:00 |
URL | https://bigditch.com.au/robots.txt |
Domain IPs | 2a02:4780:2b:1785:0:c7b:875f:2, 88.223.81.24 |
Response IP | 88.223.81.24 |
Found | Yes |
Hash | a0319c94f90fd050f4dac04b8434eea022668421e2c1ee15dce45d9dc04ca563 |
SimHash | c9386b494f4a |
Groups
*
Rule | Path |
---|---|
Disallow | /feed/ |
Disallow | */feed |
Disallow | */feed$ |
Disallow | /feed/$ |
Disallow | /comments/feed |
Disallow | /?feed= |
Disallow | /wp-feed |
Disallow | /hello-world/ |
Disallow | /thank-you/ |
Disallow | /thankyou/ |
Disallow | */*demo/ |
Disallow | */*test/ |
Disallow | */*new/ |
Disallow | /demo-*/ |
Disallow | /test-*/ |
Disallow | /*-test/ |
Disallow | /*-demo/ |
Disallow | /new-*/ |
Disallow | /home-demo/ |
Disallow | /test/ |
Disallow | /demo/ |
Disallow | /new/ |
Disallow | /landing/ |
Disallow | */*landing/ |
Disallow | /landing-*/ |
Disallow | /*-landing/ |
Disallow | */trackback/ |
Disallow | */xmlrpc.php |
Disallow | /wp-*.php |
Disallow | /cgi-bin/ |
Disallow | /wp-admin/ |
Disallow | /wp-content/ |
Disallow | /*? |
Disallow | /*?* |
Other Records
Field | Value |
---|---|
sitemap | https://www.bigditch.com.au/sitemap_index.xml |