pickbrain.net
robots.txt

Robots Exclusion Standard data for pickbrain.net

Resource Scan

Scan Details

Site Domain pickbrain.net
Base Domain pickbrain.net
Scan Status Ok
Last Scan2024-06-24T22:04:44+00:00
Next Scan 2024-07-01T22:04:44+00:00

Last Scan

Scanned2024-06-24T22:04:44+00:00
URL https://www.pickbrain.net/robots.txt
Domain IPs 104.21.21.51, 172.67.196.108, 2606:4700:3034::6815:1533, 2606:4700:3035::ac43:c46c
Response IP 172.67.196.108
Found Yes
Hash 90d13d204e6f224166e0bd099c31ccc60740084fadffad86f4d7d2ae48a92477
SimHash 6a08924606b2

Groups

mediapartners-google

Rule Path
Allow /
Disallow

*

Rule Path
Disallow /search
Allow /

Other Records

Field Value
sitemap https://pickbrain.net/feeds/posts/default?orderby=UPDATED
sitemap http://pickbrain.net/atom.xml?redirect=false&start-index=1&max-results=500
sitemap http://pickbrain.net/atom.xml?redirect=false&start-index=501&max-results=500