timesofmalta.com
robots.txt

Robots Exclusion Standard data for timesofmalta.com

Resource Scan

Scan Details

Site Domain timesofmalta.com
Base Domain timesofmalta.com
Scan Status Ok
Last Scan2024-04-27T01:07:31+00:00
Next Scan 2024-05-04T01:07:31+00:00

Last Scan

Scanned2024-04-27T01:07:31+00:00
URL https://timesofmalta.com/robots.txt
Domain IPs 104.22.36.98, 104.22.37.98, 172.67.10.89, 2606:4700:10::6816:2462, 2606:4700:10::6816:2562, 2606:4700:10::ac43:a59
Response IP 104.22.36.98
Found Yes
Hash fb744fa30e4d3b5f0cfdfae34ad6cc567b15c845c60b9e9a1735cf71f88bc1d6
SimHash 2144fc7828db

Groups

gptbot

Rule Path
Disallow /

*

Rule Path
Disallow /archive/issue
Disallow /archive/restricted-access
Disallow /archive/search
Disallow /change-password
Disallow /confirm-password
Disallow /connect-accounts
Disallow /download/
Disallow /edit-account
Disallow /email/
Disallow /epaper/restricted-access
Disallow /forgot-password
Disallow /login
Disallow /login-success
Disallow /maintenance
Disallow /manage-account
Disallow /oauth-facebook-callback
Disallow /oauth-facebook-disconnect
Disallow /oauth-facebook-redirect
Disallow /oauth-google-callback
Disallow /oauth-google-disconnect
Disallow /oauth-google-redirect
Disallow /register
Disallow /register-optional
Disallow /register-success
Disallow /report-a-bug
Disallow /reset-password
Disallow /reset-password/
Disallow /search
Disallow /set-password
Disallow /settings
Disallow /verify-email
Disallow /verify-email/

Other Records

Field Value
sitemap https://timesofmalta.com/sitemap_index.xml