smartparenting.com.ph
robots.txt

Robots Exclusion Standard data for smartparenting.com.ph

Resource Scan

Scan Details

Site Domain smartparenting.com.ph
Base Domain smartparenting.com.ph
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-08-31T09:26:41+00:00
Next Scan 2024-09-30T09:26:41+00:00

Last Successful Scan

Scanned2024-08-02T09:22:44+00:00
URL https://smartparenting.com.ph/robots.txt
Redirect https://www.smartparenting.com.ph/robots.txt
Redirect Domain www.smartparenting.com.ph
Redirect Base smartparenting.com.ph
Domain IPs 104.18.30.95, 104.18.31.95, 2606:4700::6812:1e5f, 2606:4700::6812:1f5f
Redirect IPs 104.18.30.95, 104.18.31.95, 2606:4700::6812:1e5f, 2606:4700::6812:1f5f
Response IP 104.18.31.95
Found Yes
Hash c68d8b0e08d011b27efe25c5933ea80cc9852f99961e01765952798c525f32a0
SimHash d600da7c0535

Groups

*

Rule Path
Disallow /admin
Disallow /app
Disallow /backups
Disallow /bootstrap
Disallow /conf
Disallow /vendor
Disallow /api
Disallow /subscribe
Disallow /gallery/get
Disallow /gallery/getBranded
Disallow /gallery/clicks

mediapartners-google
twitterbot
grapeshot

Rule Path
Allow /ads.txt

gptbot

Rule Path
Disallow /

chatgpt-user

Rule Path
Disallow /

google-extended

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

perplexitybot

Rule Path
Disallow /

anthropic-ai

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.smartparenting.com.ph/sitemap.xml