bdtimes.com.au
robots.txt

Robots Exclusion Standard data for bdtimes.com.au

Resource Scan

Scan Details

Site Domain bdtimes.com.au
Base Domain bdtimes.com.au
Scan Status Ok
Last Scan2024-10-25T22:42:39+00:00
Next Scan 2024-11-01T22:42:39+00:00

Last Scan

Scanned2024-10-25T22:42:39+00:00
URL https://bdtimes.com.au/robots.txt
Redirect https://www.bdtimes.com.au/robots.txt
Redirect Domain www.bdtimes.com.au
Redirect Base bdtimes.com.au
Domain IPs 2600:9000:271a:1800:13:d8b0:4880:93a1, 2600:9000:271a:4a00:13:d8b0:4880:93a1, 2600:9000:271a:6200:13:d8b0:4880:93a1, 2600:9000:271a:6c00:13:d8b0:4880:93a1, 2600:9000:271a:e400:13:d8b0:4880:93a1, 2600:9000:271a:f000:13:d8b0:4880:93a1, 2600:9000:271a:f400:13:d8b0:4880:93a1, 2600:9000:271a:fc00:13:d8b0:4880:93a1, 3.165.82.110, 3.165.82.47, 3.165.82.88, 3.165.82.99
Redirect IPs 2600:9000:271a:3400:1:5193:880:93a1, 2600:9000:271a:3800:1:5193:880:93a1, 2600:9000:271a:7000:1:5193:880:93a1, 2600:9000:271a:8000:1:5193:880:93a1, 2600:9000:271a:d000:1:5193:880:93a1, 2600:9000:271a:e200:1:5193:880:93a1, 2600:9000:271a:e600:1:5193:880:93a1, 2600:9000:271a:f600:1:5193:880:93a1, 3.165.82.123, 3.165.82.18, 3.165.82.50, 3.165.82.65
Response IP 3.165.82.50
Found Yes
Hash e7c1a603cd8603eb1176eae9c65a51b6eba4421cebbcdccb25a114021bfd073f
SimHash 691d8d30aed2

Groups

*

Rule Path
Disallow
Disallow /search

googlebot-image

Rule Path
Disallow /assets/profiles/*_thumb.png$

Other Records

Field Value
sitemap https://www.bdtimes.com.au/sitemap.xml
sitemap https://www.bdtimes.com.au/news-sitemap.xml