titanwelding.co.za
robots.txt

Robots Exclusion Standard data for titanwelding.co.za

Resource Scan

Scan Details

Site Domain titanwelding.co.za
Base Domain titanwelding.co.za
Scan Status Ok
Last Scan2024-10-31T18:17:34+00:00
Next Scan 2024-11-07T18:17:34+00:00

Last Scan

Scanned2024-10-31T18:17:34+00:00
URL https://titanwelding.co.za/robots.txt
Domain IPs 104.21.2.148, 172.67.129.82, 2606:4700:3032::ac43:8152, 2606:4700:3036::6815:294
Response IP 104.21.2.148
Found Yes
Hash 4a893b45aebeee190ac1bc5e23560cff65ff7eb83c29b62aa93c2dc43a14e46e
SimHash a41747d0afb1

Groups

mediapartners-google

Rule Path
Disallow

*

Rule Path
Allow /
Disallow /dl/
Disallow /dl/
Disallow /convert/
Disallow /convert/*
Disallow /music/song/
Disallow /music/song/*
Disallow /music/video/
Disallow /music/download
Disallow /music/
Disallow /music/video/*
Disallow /cdn-cgi/
Disallow /cdn-cgi/*

Other Records

Field Value
sitemap https://mp3juicex.org.za/sitemap.xml