devdiscourse-testslot.azurewebsites.net
robots.txt

Robots Exclusion Standard data for devdiscourse-testslot.azurewebsites.net

Resource Scan

Scan Details

Site Domain devdiscourse-testslot.azurewebsites.net
Base Domain devdiscourse-testslot.azurewebsites.net
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-05-21T18:47:10+00:00
Next Scan 2024-06-20T18:47:10+00:00

Last Successful Scan

Scanned2024-04-22T16:12:08+00:00
URL https://devdiscourse-testslot.azurewebsites.net/robots.txt
Domain IPs 13.71.123.138
Response IP 13.71.123.138
Found Yes
Hash bc43f1f049780636d92e734eb42baa0e01b2055def8a2dfbb8e1975079dfa9c9
SimHash 0828c011c4d0

Groups

*

Rule Path
Disallow /Home/ViewsCount
Disallow /Home/SaveComment
Disallow /Home/GetComments
Disallow /Home/GetCountry
Disallow /DefaultCaptcha/Refresh
Disallow /About/SubmitAdvertisement
Disallow /post-comments
Disallow /AdminFiles/Ads
Allow /

Other Records

Field Value
sitemap https://www.devdiscourse.com/sitemap.xml
sitemap https://www.devdiscourse.com/rss/googlenews
sitemap https://www.devdiscourse.com/rss/livediscourse