infronttech.com.au
robots.txt

Robots Exclusion Standard data for infronttech.com.au

Resource Scan

Scan Details

Site Domain infronttech.com.au
Base Domain infronttech.com.au
Scan Status Ok
Last Scan2025-08-31T09:01:55+00:00
Next Scan 2025-09-30T09:01:55+00:00

Last Scan

Scanned2025-08-31T09:01:55+00:00
URL https://infronttech.com.au/robots.txt
Domain IPs 172.66.41.13, 172.66.42.243, 2606:4700:3108::ac42:290d, 2606:4700:3108::ac42:2af3
Response IP 172.66.41.13
Found Yes
Hash 8212c34a68ed7e6d371fdc10cdbbdf5397898fe24c82ca06d8661b18bccf9af4
SimHash 08401982c53b

Groups

*

Rule Path
Allow /*.js$
Allow /*.css$
Allow /*.jpg$
Allow /*.jpeg$
Allow /*.png$
Allow /*.gif$
Allow /modules/googleexport/export/
Allow /js/jquery/*
Disallow /*?*order=
Disallow /*?*tag=
Disallow /*?*id_currency=
Disallow /*?*back=
Disallow /*?*n=
Disallow /*controller%3Daddresses*
Disallow /*controller%3Dauthentication*
Disallow /*controller%3Dcart*
Disallow /*controller%3Dhistory*
Disallow /*controller%3Dorder*
Disallow /*controller%3Dproduct-sort*
Disallow /*controller%3Dpagination*
Disallow /*controller%3Dstatistics*
Disallow /app/
Disallow /cache/
Disallow /classes/
Disallow /config/
Disallow /controllers/
Disallow /download/
Disallow /localization/
Disallow /log/
Disallow /mails/
Disallow /modules/
Disallow /override/
Disallow /pdf/
Disallow /src/
Disallow /tools/
Disallow /translations/
Disallow /upload/
Disallow /var/
Disallow /vendor/
Disallow /webservice/

amazon-kendra-web-crawler-*

Rule Path
Disallow /

amazon-kendra

Rule Path
Disallow /

Other Records

Field Value
sitemap https://infronttech.com.au/sitemap.xml

Comments

  • Allow essential resources for proper rendering
  • Disallow unnecessary URL parameters
  • Block Amazon crawlers
  • Sitemap