Log In Sign Up

vmta.org.au
robots.txt

Robots Exclusion Standard data for vmta.org.au

Resource Scan

Scan Details

Site Domain vmta.org.au
Base Domain vmta.org.au
Scan Status Ok
Last Scan2024-09-08T04:35:50+00:00
Next Scan 2024-10-08T04:35:50+00:00

Last Scan

Scanned2024-09-08T04:35:50+00:00
URL https://www.vmta.org.au/robots.txt
Domain IPs 13.227.254.13, 13.227.254.64, 13.227.254.80, 13.227.254.91, 2600:9000:200a:1e00:1c:4ae8:69c0:93a1, 2600:9000:200a:3400:1c:4ae8:69c0:93a1, 2600:9000:200a:4200:1c:4ae8:69c0:93a1, 2600:9000:200a:5a00:1c:4ae8:69c0:93a1, 2600:9000:200a:7a00:1c:4ae8:69c0:93a1, 2600:9000:200a:dc00:1c:4ae8:69c0:93a1, 2600:9000:200a:f000:1c:4ae8:69c0:93a1, 2600:9000:200a:f800:1c:4ae8:69c0:93a1
Response IP 13.227.254.13
Found Yes
Hash b4c2624f7e507891ec8cd5e08f2c2834a4ad63e1f9a0b08dfce3177f20813698
SimHash 415459d1c7e4

Groups

*

Rule Path Comment
Disallow /* Disallow everything
Allow /public/*/website/favicon.ico -

googlebot

Rule Path
Disallow /public/
Allow /public/*/website/favicon.ico
Allow /

Other Records

Field Value
crawl-delay 10

bingbot

Rule Path
Disallow /public/
Allow /public/*/website/favicon.ico
Allow /

Other Records

Field Value
crawl-delay 10

powermapper

Rule Path
Disallow /public/
Allow /public/*/website/favicon.ico
Allow /

Other Records

Field Value
crawl-delay 10
Back to top

Comments

  • Allow favicon.ico with wildcard for directory segment
Back to top