somaly.org
robots.txt

Robots Exclusion Standard data for somaly.org

Resource Scan

Scan Details

Site Domain somaly.org
Base Domain somaly.org
Scan Status Ok
Last Scan2025-10-06T22:52:37+00:00
Next Scan 2025-11-05T22:52:37+00:00

Last Scan

Scanned2025-10-06T22:52:37+00:00
URL https://somaly.org/robots.txt
Redirect https://www.somaly.org/robots.txt
Redirect Domain www.somaly.org
Redirect Base somaly.org
Domain IPs 152.232.82.9
Redirect IPs 152.232.82.9
Response IP 152.232.82.9
Found Yes
Hash 40c66d3dc78ee276ffe6346c4046bd86a3c31f31cdedcba82ab6413582bb7bd4
SimHash 48445c825792

Groups

*

Rule Path
Disallow /comments/feed
Disallow /feed/$
Disallow /*/feed/$
Disallow /*/feed/rss/$
Disallow /*/trackback/$
Disallow /*/*/feed/$
Disallow /*/*/feed/rss/$
Disallow /*/*/trackback/$
Disallow /*/*/*/feed/$
Disallow /*/*/*/feed/rss/$
Disallow /*/*/*/trackback/$
Disallow /trackback/
Disallow /wp-admin/
Disallow /*.inc$
Disallow */trackback/

mediapartners-google

Rule Path
Allow /

adsbot-google

Rule Path
Allow /

googlebot-image

Rule Path
Allow /

googlebot-mobile

Rule Path
Allow /

ia_archiver

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.somaly.org/sitemap.xml

Warnings

  • `` is not a known field.