Log In Sign Up

bdtimes.com.au
robots.txt

Robots Exclusion Standard data for bdtimes.com.au

Resource Scan

Scan Details

Site Domain bdtimes.com.au
Base Domain bdtimes.com.au
Scan Status Ok
Last Scan2024-06-07T19:34:46+00:00
Next Scan 2024-06-14T19:34:46+00:00

Last Scan

Scanned2024-06-07T19:34:46+00:00
URL https://bdtimes.com.au/robots.txt
Redirect https://www.bdtimes.com.au/robots.txt
Redirect Domain www.bdtimes.com.au
Redirect Base bdtimes.com.au
Domain IPs 2600:9000:271a:2400:13:d8b0:4880:93a1, 2600:9000:271a:5400:13:d8b0:4880:93a1, 2600:9000:271a:9800:13:d8b0:4880:93a1, 2600:9000:271a:b400:13:d8b0:4880:93a1, 2600:9000:271a:c200:13:d8b0:4880:93a1, 2600:9000:271a:ee00:13:d8b0:4880:93a1, 2600:9000:271a:f200:13:d8b0:4880:93a1, 2600:9000:271a:f800:13:d8b0:4880:93a1, 3.165.82.110, 3.165.82.47, 3.165.82.88, 3.165.82.99
Redirect IPs 2600:9000:2003:1000:1:5193:880:93a1, 2600:9000:2003:1600:1:5193:880:93a1, 2600:9000:2003:1a00:1:5193:880:93a1, 2600:9000:2003:2000:1:5193:880:93a1, 2600:9000:2003:6c00:1:5193:880:93a1, 2600:9000:2003:b800:1:5193:880:93a1, 2600:9000:2003:ca00:1:5193:880:93a1, 2600:9000:2003:d800:1:5193:880:93a1, 52.84.229.16, 52.84.229.4, 52.84.229.51, 52.84.229.87
Response IP 52.84.229.51
Found Yes
Hash e7c1a603cd8603eb1176eae9c65a51b6eba4421cebbcdccb25a114021bfd073f
SimHash 691d8d30aed2

Groups

*

Rule Path
Disallow
Disallow /search

googlebot-image

Rule Path
Disallow /assets/profiles/*_thumb.png$
Back to top

Other Records

Field Value
sitemap https://www.bdtimes.com.au/sitemap.xml
sitemap https://www.bdtimes.com.au/news-sitemap.xml
Back to top