dweb.vn
robots.txt

Robots Exclusion Standard data for dweb.vn

Resource Scan

Scan Details

Site Domain dweb.vn
Base Domain dweb.vn
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't connect to server.
Last Scan2025-03-19T04:46:37+00:00
Next Scan 2025-06-17T04:46:37+00:00

Last Successful Scan

Scanned2023-08-04T23:59:02+00:00
URL https://dweb.vn/robots.txt
Domain IPs 104.21.75.151, 172.67.177.230, 2606:4700:3032::6815:4b97, 2606:4700:3035::ac43:b1e6
Response IP 104.21.75.151
Found Yes
Hash f2973c2a06ac328e310f3fefbc71e535d98ab2cbe2fb6dbbef75767f1de84397
SimHash 69015c404fb3

Groups

*

Rule Path
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php

Other Records

Field Value
sitemap https://dweb.vn/sitemap_index.xml