pleno.news
robots.txt

Robots Exclusion Standard data for pleno.news

Resource Scan

Scan Details

Site Domain pleno.news
Base Domain pleno.news
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-10-21T12:17:36+00:00
Next Scan 2024-12-20T12:17:36+00:00

Last Successful Scan

Scanned2024-08-23T09:21:37+00:00
URL https://pleno.news/robots.txt
Domain IPs 170.82.173.30, 170.82.174.30
Response IP 170.82.173.30
Found Yes
Hash 434fe4a16aa60ff344f664b91ee92b5b44f20304317a642b180a9b89367ef594
SimHash 28489ac004b2

Groups

*

Rule Path
Allow /

Other Records

Field Value
crawl-delay 60

semrushbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 60

googlebot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 60

facebookbot

Rule Path
Disallow /busca/*

Other Records

Field Value
crawl-delay 60

Other Records

Field Value
sitemap https://pleno.news/sitemap.xml