webgyans.com
robots.txt

Robots Exclusion Standard data for webgyans.com

Resource Scan

Scan Details

Site Domain webgyans.com
Base Domain webgyans.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-11-21T20:24:48+00:00
Next Scan 2025-12-21T20:24:48+00:00

Last Successful Scan

Scanned2025-10-22T03:12:30+00:00
URL https://webgyans.com/robots.txt
Domain IPs 179.61.189.237, 2a02:4780:15:c3ae:5602:bc8:4df5:1fe, 2a02:4780:16:6426:4543:b06e:26f6:8b19, 77.37.66.127
Response IP 93.127.201.82
Found Yes
Hash 358b8b6d85362033acc128087784ddc9d25a8cf5da62defcb64d7af31194f8fa
SimHash 4904da0043b2

Groups

mediapartners-google

Rule Path
Allow /

*

Rule Path
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php

Other Records

Field Value
sitemap https://webgyans.com/sitemap_index.xml