networthexplorers.com
robots.txt

Robots Exclusion Standard data for networthexplorers.com

Resource Scan

Scan Details

Site Domain networthexplorers.com
Base Domain networthexplorers.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't connect to server.
Last Scan2024-09-12T13:59:35+00:00
Next Scan 2024-11-11T13:59:35+00:00

Last Successful Scan

Scanned2024-07-15T05:23:05+00:00
URL https://networthexplorers.com/robots.txt
Redirect https://www.networthexplorers.com/robots.txt
Redirect Domain www.networthexplorers.com
Redirect Base networthexplorers.com
Domain IPs 2406:da18:9d0:143f:2124:4e9c:36a9:d9de, 52.221.42.138
Redirect IPs 104.21.68.213, 172.67.198.171, 2606:4700:3031::6815:44d5, 2606:4700:3034::ac43:c6ab
Response IP 172.67.198.171
Found Yes
Hash 4e94ac756e75fb897f6c1da3d034afa85be664acdcef94901897b2014d5db39e
SimHash c944dd50dfd3

Groups

*

Rule Path
Disallow /search
Disallow /category/
Disallow /tag/
Allow /

Other Records

Field Value
sitemap https://www.networthexplorers.com/atom.xml?redirect=false&start-index=1&max-results=500