lactalis.com.au
robots.txt
Robots Exclusion Standard data for lactalis.com.au
Resource Scan
Scan Details
Site Domain | lactalis.com.au |
Base Domain | lactalis.com.au |
Scan Status | Ok |
Last Scan | 6/5/2025, 1:39:32 PM |
Next Scan | 7/5/2025, 1:39:32 PM |
Last Scan
Scanned | 6/5/2025, 1:39:32 PM |
URL | https://lactalis.com.au/robots.txt |
Domain IPs | 45.60.14.78, 45.60.16.78 |
Response IP | 45.60.14.78 |
Found | Yes |
Hash | 69a7dedc263f097b2d3e0df10decc5b9d84d01d17c22fa69d202bdf6f88cb542 |
SimHash | d14be801ced1 |
Groups
*
Rule | Path | Comment |
---|---|---|
Disallow | /wp-admin/ | - |
Disallow | /pdfs/ | Block the /pdfs/directory. |
Disallow | Block pdf files. Non-standard but works for major search engines. | |
Disallow | *.pdf$ | - |