nestfy.blogspot.com
robots.txt

Robots Exclusion Standard data for nestfy.blogspot.com

Resource Scan

Scan Details

Site Domain nestfy.blogspot.com
Base Domain nestfy.blogspot.com
Scan Status Ok
Last Scan2024-07-02T19:30:40+00:00
Next Scan 2024-07-09T19:30:40+00:00

Last Scan

Scanned2024-07-02T19:30:40+00:00
URL https://nestfy.blogspot.com/robots.txt
Domain IPs 172.217.194.132, 2404:6800:4003:c03::84
Response IP 142.251.12.132
Found Yes
Hash 7c459b501167643c0cc93cacd39cea40f09302c0c10bfcfb06971e8d7d033ee3
SimHash 6d741bd0c4d3

Groups

archive.org

Rule Path
Disallow /search
Disallow /category
Disallow /tag
Allow /

adsbot-google

Rule Path
Allow /

mediapartners-google

Rule Path
Allow /

download ninja

Rule Path
Disallow /

fetch

Rule Path
Disallow /

hmse_robot

Rule Path
Disallow /

httrack

Rule Path
Disallow /

webcopier

Rule Path
Disallow /

webreaper

Rule Path
Disallow /

googlebot

Rule Path
Allow /sitemap.xml
Allow /

*

Rule Path
Allow /sitemap.xml
Allow /sitemap
Allow /

Other Records

Field Value
sitemap https://nestfy.blogspot.com/atom.xml?redirect=false&start-index=1&max-results=500