mtigroup.com.au
robots.txt

Robots Exclusion Standard data for mtigroup.com.au

Resource Scan

Scan Details

Site Domain mtigroup.com.au
Base Domain mtigroup.com.au
Scan Status Ok
Last Scan2026-01-23T22:26:13+00:00
Next Scan 2026-02-22T22:26:13+00:00

Last Scan

Scanned2026-01-23T22:26:13+00:00
URL https://mtigroup.com.au/robots.txt
Redirect https://www.mtigroup.com.au/robots.txt
Redirect Domain www.mtigroup.com.au
Redirect Base mtigroup.com.au
Domain IPs 199.34.229.100
Redirect IPs 199.34.229.100
Response IP 199.34.229.100
Found Yes
Hash 0e5a143c7c58c392cd03140d8060159ea5fa4dd8c563f95ad6a6edcbc062de18
SimHash 0944d0760e93

Groups

nerdybot

Rule Path
Disallow /

dotbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

*

Rule Path
Disallow /ajax/
Disallow /apps/
Disallow /products.html
Disallow /solutions.html
Disallow /blastbags.html
Disallow /testing--standards.html
Disallow /site-services.html
Disallow /about-us1.html
Disallow /abc.html
Disallow /policies.html
Disallow /404.html
Disallow /riplog-old.html

Other Records

Field Value
sitemap https://www.mtigroup.com.au/sitemap.xml