topwebs.org
robots.txt

Robots Exclusion Standard data for topwebs.org

Resource Scan

Scan Details

Site Domain topwebs.org
Base Domain topwebs.org
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-04-17T00:22:03+00:00
Next Scan 2025-05-01T00:22:03+00:00

Last Successful Scan

Scanned2025-03-10T00:21:18+00:00
URL https://topwebs.org/robots.txt
Redirect https://dailynewstv.co/robots.txt
Redirect Domain dailynewstv.co
Redirect Base dailynewstv.co
Domain IPs 104.21.72.84, 172.67.177.141, 2606:4700:3030::6815:4854, 2606:4700:3033::ac43:b18d
Redirect IPs 104.21.43.19, 172.67.215.219, 2606:4700:3030::6815:2b13, 2606:4700:3037::ac43:d7db
Response IP 172.67.215.219
Found Yes
Hash 3f2b83d6607efcbd030cbb32ffd6b76da44b0c787e42a78560cff5a906a4dec6
SimHash 490088408d92

Groups

*

Rule Path
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php

Other Records

Field Value
sitemap https://dailynewstv.co/sitemap.xml