tenantapp.com.au
robots.txt

Robots Exclusion Standard data for tenantapp.com.au

Resource Scan

Scan Details

Site Domain tenantapp.com.au
Base Domain tenantapp.com.au
Scan Status Ok
Last Scan2024-11-16T10:53:46+00:00
Next Scan 2024-11-23T10:53:46+00:00

Last Scan

Scanned2024-11-16T10:53:46+00:00
URL https://tenantapp.com.au/robots.txt
Domain IPs 13.107.246.31, 2620:1ec:bdf::31
Response IP 13.107.246.31
Found Yes
Hash e7347cb5bf6ae3029b2516ffc0275e79da9018ac27a2ea4d4c2086301fa8829f
SimHash 494cfb00ec33

Groups

*

Rule Path
Disallow /*?*page=
Disallow /search-in/*$
Disallow /*/*/*unit*$
Disallow /*/*/*townhouse*$
Disallow /*/*/*cheap*$
Disallow /*/*/*luxury*$
Disallow /*/*/*bedroom*$

mediapartners-google

Rule Path
Allow *

yakazbot

Rule Path
Disallow /

trovitbot

Rule Path
Disallow /

eyeotabot

Rule Path
Disallow /

piplbot

Rule Path
Disallow /

criteobot/0.1

Rule Path
Disallow /

trendkite-akashic-crawler

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.tenantapp.com.au/sitemap.xml
sitemap https://www.tenantapp.com.au/sitemap_house.xml
sitemap https://www.tenantapp.com.au/sitemap_apartment.xml