20thcenturystudios.com.au
robots.txt

Robots Exclusion Standard data for 20thcenturystudios.com.au

Resource Scan

Scan Details

Site Domain 20thcenturystudios.com.au
Base Domain 20thcenturystudios.com.au
Scan Status Failed
Failure ReasonScan timed out.
Last Scan2024-10-25T05:22:12+00:00
Next Scan 2024-11-08T05:22:12+00:00

Last Successful Scan

Scanned2024-09-17T05:05:28+00:00
URL https://www.20thcenturystudios.com.au/robots.txt
Domain IPs 23.46.230.131, 23.46.230.141, 2600:1413:b000:1e::17d1:2e53, 2600:1413:b000:1e::17d1:2e5a
Response IP 23.49.60.95
Found Yes
Hash e67519c40acc2b02bec345f2ed4e3e829558cfc769e8913f338baf4e3fcd342b
SimHash 2b0dd800e553

Groups

gptbot

Rule Path
Disallow /

google-extended

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.20thcenturystudios.com.au/sitemap.xml