thenews.sg
robots.txt

Robots Exclusion Standard data for thenews.sg

Resource Scan

Scan Details

Site Domain thenews.sg
Base Domain thenews.sg
Scan Status Ok
Last Scan5/17/2025, 2:36:29 AM
Next Scan 5/24/2025, 2:36:29 AM

Last Scan

Scanned5/17/2025, 2:36:29 AM
URL https://thenews.sg/robots.txt
Domain IPs 104.21.20.252, 172.67.195.62, 2606:4700:3031::ac43:c33e, 2606:4700:3036::6815:14fc
Response IP 104.21.20.252
Found Yes
Hash e6dea1640475fcc874af25484eba086399335fe17b8ae180883237fc92fd0d88
SimHash 610088400f93

Groups

*

Rule Path
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php

Other Records

Field Value
sitemap https://thenews.sg/sitemap_index.xml