piknikdong.com
robots.txt

Robots Exclusion Standard data for piknikdong.com

Resource Scan

Scan Details

Site Domain piknikdong.com
Base Domain piknikdong.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a server error.
Last Scan2024-05-28T15:48:14+00:00
Next Scan 2024-06-04T15:48:14+00:00

Last Successful Scan

Scanned2024-05-20T15:47:25+00:00
URL https://piknikdong.com/robots.txt
Domain IPs 104.21.44.154, 172.67.200.233, 2606:4700:3030::6815:2c9a, 2606:4700:3032::ac43:c8e9
Response IP 104.21.44.154
Found Yes
Hash f688abda77ca53de5ece0b1ec75a063a95700b880fc2f6683606ddb03f6067ce
SimHash 621c802209ba

Groups

*

Rule Path
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php

semrush

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

obot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

siteexplorer

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.piknikdong.com/sitemap_index.xml
sitemap https://www.piknikdong.com/sitemap-news.xml