piwik.org
robots.txt

Robots Exclusion Standard data for piwik.org

Resource Scan

Scan Details

Site Domain piwik.org
Base Domain piwik.org
Scan Status Ok
Last Scan2024-05-01T16:54:02+00:00
Next Scan 2024-05-31T16:54:02+00:00

Last Scan

Scanned2024-05-01T16:54:02+00:00
URL https://piwik.org/robots.txt
Redirect https://matomo.org/robots.txt
Redirect Domain matomo.org
Redirect Base matomo.org
Domain IPs 185.31.40.177, 2a00:b6e0:1:200:177::1
Redirect IPs 13.33.30.12, 13.33.30.44, 13.33.30.67, 13.33.30.78, 2600:9000:243b:2c00:1e:6cc8:7300:93a1, 2600:9000:243b:3800:1e:6cc8:7300:93a1, 2600:9000:243b:3c00:1e:6cc8:7300:93a1, 2600:9000:243b:5600:1e:6cc8:7300:93a1, 2600:9000:243b:9600:1e:6cc8:7300:93a1, 2600:9000:243b:9c00:1e:6cc8:7300:93a1, 2600:9000:243b:ce00:1e:6cc8:7300:93a1, 2600:9000:243b:e00:1e:6cc8:7300:93a1
Response IP 13.33.30.78
Found Yes
Hash 16b91247ea8e4412da79fe8d535ef4c874100a2e701fee053cc43c7f83fafb94
SimHash 618098e3cba6

Groups

*

Rule Path
Disallow /wp-admin/
Disallow /recommends/
Disallow /e-landing-page-sitemap.xml
Disallow /post_tag-sitemap.xml
Disallow /author-sitemap.xml
Disallow /category-sitemap.xml
Allow /wp-admin/admin-ajax.php

Other Records

Field Value
crawl-delay 20