aviair.com.au
robots.txt

Robots Exclusion Standard data for aviair.com.au

Resource Scan

Scan Details

Site Domain aviair.com.au
Base Domain aviair.com.au
Scan Status Ok
Last Scan2024-04-21T12:00:34+00:00
Next Scan 2024-05-21T12:00:34+00:00

Last Scan

Scanned2024-04-21T12:00:34+00:00
URL https://aviair.com.au/robots.txt
Redirect https://www.aviair.com.au/robots.txt
Redirect Domain www.aviair.com.au
Redirect Base aviair.com.au
Domain IPs 104.21.2.134, 172.67.129.64, 2606:4700:3033::ac43:8140, 2606:4700:3037::6815:286
Redirect IPs 104.21.2.134, 172.67.129.64, 2606:4700:3033::ac43:8140, 2606:4700:3037::6815:286
Response IP 104.21.2.134
Found Yes
Hash 0a37ffd9e135a58f3c1f031958598696a31d49d75aaef33345de7303f061921a
SimHash e911444278b3

Groups

twitterbot

Rule Path
Disallow *
Allow /cms/uploads/*
Allow /uploads/*

*

Rule Path
Disallow /admin/
Disallow /m/
Disallow /cgi-bin/
Disallow /cms/pdf/
Disallow /cms/contrib/
Disallow /cms/doc/
Disallow /cms/lib/
Disallow /cms/modules/
Disallow /cms/plugins/
Disallow /cms/scripts/
Disallow /cms/tmp/
Disallow /jasonMap/
Disallow /feeds/
Disallow /dev/

mj12bot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.aviair.com.au/sitemap.xml