marketcheck.com.au
robots.txt

Robots Exclusion Standard data for marketcheck.com.au

Resource Scan

Scan Details

Site Domain marketcheck.com.au
Base Domain marketcheck.com.au
Scan Status Ok
Last Scan2024-06-11T01:31:01+00:00
Next Scan 2024-07-11T01:31:01+00:00

Last Scan

Scanned2024-06-11T01:31:01+00:00
URL https://marketcheck.com.au/robots.txt
Domain IPs 192.250.232.12
Response IP 192.250.232.12
Found Yes
Hash ebe4e14adacf919d0b06d65a43c2e1cc81c91281bcf9eac35dc1e4ac47b1df37
SimHash 30b51b24e643

Groups

*

Rule Path
Disallow /Files/
Disallow /Offer/
Disallow /Page/
Disallow /webapp2011x_disabled_2016-12-09
Disallow /webapp2016x
Disallow /32256*
Disallow /2016/

Comments

  • robots.txt for http://www.example.com/