startupdaily.net
robots.txt

Robots Exclusion Standard data for startupdaily.net

Resource Scan

Scan Details

Site Domain startupdaily.net
Base Domain startupdaily.net
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-10-14T13:17:22+00:00
Next Scan 2025-01-12T13:17:22+00:00

Last Successful Scan

Scanned2023-09-20T21:31:06+00:00
URL https://startupdaily.net/robots.txt
Domain IPs 172.66.40.169, 172.66.43.87, 2606:4700:3108::ac42:28a9, 2606:4700:3108::ac42:2b57
Response IP 172.66.40.169
Found Yes
Hash d8b0857345a8a18dced6a66f2f3f2d7ebdbcf74c556e1b4180c3366d25740603
SimHash 422c53204133

Groups

*

Rule Path
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php

googlebot-news

Rule Path
Allow /

applebot

Rule Path
Allow /

grapeshot

Rule Path
Disallow

Other Records

Field Value
sitemap https://www.startupdaily.net/sitemap_index.xml