portaldocpf.com.br
robots.txt

Robots Exclusion Standard data for portaldocpf.com.br

Resource Scan

Scan Details

Site Domain portaldocpf.com.br
Base Domain portaldocpf.com.br
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't connect to server.
Last Scan2025-09-16T19:10:11+00:00
Next Scan 2025-12-15T19:10:11+00:00

Last Successful Scan

Scanned2025-02-19T17:31:36+00:00
URL https://www.portaldocpf.com.br/robots.txt
Domain IPs 104.21.59.61, 172.67.216.157, 2606:4700:3033::ac43:d89d, 2606:4700:3034::6815:3b3d
Response IP 172.67.216.157
Found Yes
Hash 17a07b4a709c6828d25058980c3bc9c632bd4a1fee27b7f96cff5a0c731a8395
SimHash 6b8419c05311

Groups

googlebot

Rule Path
Allow

googlebot-image

Rule Path
Allow

mediapartners-google

Rule Path
Allow

adsbot-google

Rule Path
Allow

yahoo! slurp

Rule Path
Allow

bingbot

Rule Path
Disallow /

baidu

Rule Path
Allow

yandex

Rule Path
Allow

duckduckgo

Rule Path
Allow

sogou

Rule Path
Allow

exalead

Rule Path
Allow

qwant

Rule Path
Allow

aol

Rule Path
Allow

ask jeeves

Rule Path
Allow

*

Rule Path
Disallow /wp-admin/
Disallow /wp-includes/
Disallow /wp-content/
Disallow /wp
Allow /wp-content/uploads/

Other Records

Field Value
sitemap https://beneficiodoinss.com.br/sitemap_index.xml