Re: Storage Patterns for container native - community content


Mark Coleman <mark@...>
 

Morning and my apologies for joining the call late.

I've sent over another meeting request for 08:30am next Thursday so we can see how this is progressing.

Also, as Chris mentioned above, having this out in the open would be of great benefit: https://github.com/cncf/wg-storage

Mark

On Wed, Mar 1, 2017 at 8:00 AM Chris Aniszczyk via cncf-toc <cncf-toc@...> wrote:
imho it makes sense, would love to see the storage wg start working here in the open: https://github.com/cncf/wg-storage

On Wed, Mar 1, 2017 at 9:56 AM, Alexis Richardson via cncf-toc <cncf-toc@...> wrote:
+benh

On Wed, Mar 1, 2017 at 3:18 PM, Alex Chircop via cncf-toc <cncf-toc@...> wrote:

 

We are making some updates to the doc based on some of the feedback.  

 

I do agree, we need to show how cloud native is different in terms of how you deploy and rebuild a POD, but I also believe that users are interested in how to manage the persistence that is required by the POD in terms of the databases, object stores, message queues and  instrumentation/logs that provide the services that POD requires for persistence.   The classes of storage that are used to build these services in terms of accessibility, performance, scalability, qos, portability are important, policy/scheduler based decisions such as security, encryption and placement are key, and for some there may still be dependencies on replication, snapshots etc …    This is why we wanted to flesh out some of the storage primitives that would be considered.

 

Question – would this discussion and the content that we are working on be a suitable topic for the newly defined storage working group ?

 

Thanks,

Alex

 

From: Yaron Haviv <yaronh@...>
Date: Friday, 24 February 2017 at 06:48
To: Alex Chircop <alex.chircop@...>, "Kitson, Clinton" <Clinton.Kitson@...>, "cncf-toc@..." <cncf-toc@...>


Subject: RE: [cncf-toc] Storage Patterns for container native - community content

 

Alex,

 

I agree with Clinton’s point that we want to focus on what makes Cloud-Native different, not sure covering all the legacy Storage protocols serves that purpose

There are too many users today that try to fit VM concepts into Cloud-Native and take us out of focus

The key point is allowing continuous development and ops, elasticity, distribution, ..

Looking at the 12 factors, notions of Stateless & immutable tasks, Service bindings (to data), Atomicity are enabling that

 

It’s a different craft than today’s storage approached as I highlighted in my blog post, e.g. you don’t snapshot/backup a POD, you build it from a Git tag

You use message queues to enable elastic scaling and fault-tolerance, you store data using atomic operations (to Obj/NoSQL) vs trust file-systems to flush data out and risk inconsistent states. For the guys who would argue they want to snapshot stateful services like Mongo/Cassandra/Object, a short reminder is those are un-coordinated scaled-out instances, and in many cases versioning and re-builds are built into it

 

Yaron

 

From: Alex Chircop [mailto:alex.chircop@...]
Sent: Friday, February 24, 2017 4:14 PM
To: Kitson, Clinton <Clinton.Kitson@...>; Yaron Haviv <yaronh@...>; cncf-toc@...
Subject: RE: [cncf-toc] Storage Patterns for container native - community content

 

Clinton / Yaron,

 

Thank you for the feedback.   We will get some of that added to the doc, although we were thinking of covering some of those topics in more depth in future articles.   We’ll update the draft and recirculate.

 

Thanks,

Alex

 

 

 

From: Kitson, Clinton [mailto:Clinton.Kitson@...]
Sent: Thursday, February 23, 2017 4:11 AM
To: Yaron Haviv <yaronh@...>; Alex Chircop <alex.chircop@...>; cncf-toc@...
Subject: RE: [cncf-toc] Storage Patterns for container native - community content

 

Alex,

 

Sorry for the late review. My concern currently is that the document spends 80% of the time talking about what is known about some storage platforms today and the last portion discussing what looks to be technical details of a specific storage platform implementation. Cloud native with storage is definitely different, and just applying existing hardware thinking to this new area doesn't feel quite right.

 

Here are some of the questions that I think should be answered which leads towards a "what is cloud native storage topic".

 

What makes storage in cloud native computing different?

What cloud native applications require persistent storage of any form?

What kinds of storage services are used with cloud native applications?

What role does integration and interoperability play to build cloud native storage?

What opportunities do cloud native orchestrators present for operating persistent storage platforms?

What is cloud native storage?

 

 

Clint Kitson

Technical Director

{code} by Dell EMC

--- 

mobile: "+1 424 645 4116"

team: codeDellEMC.com

twitter: "@clintonskitson"


From: cncf-toc-bounces@... [cncf-toc-bounces@...] on behalf of Yaron Haviv via cncf-toc [cncf-toc@...]
Sent: Wednesday, February 22, 2017 11:23 AM
To: Alex Chircop; cncf-toc@...
Subject: Re: [cncf-toc] Storage Patterns for container native - community content

I wrote a post a while ago on impact of Cloud-Native on Storage, can reuse its content, you may want to take the abstraction to the next level just like we did on compute (from VMs to services/apps).

 

https://sdsblog.com/2015/09/16/cloud-native-will-shake-up-enterprise-storage/

 

Yaron

 

From: cncf-toc-bounces@... [mailto:cncf-toc-bounces@...] On Behalf Of Alex Chircop via cncf-toc
Sent: Wednesday, February 22, 2017 6:31 PM
To: cncf-toc@...
Subject: Re: [cncf-toc] Storage Patterns for container native - community content

 

Hi,

 

We have prepared the content for the first topic in the list (albeit a little later than we hoped for).   This is the first doc we have produced and is meant to serve as an overview of storage concepts to provide some background before going into the more detailed content articles we are planning next.   We have tried to keep it fairly broad and have touched on some of the technologies found in many enterprises as well as in CN environments like virtual and distributed options.

 

I’d like to know your thoughts and get feedback and comments (I’m sure there will be loads) so that we can make it a better doc for the community.   Also, as per the previous request – we would be very happy to work with anybody else who might have some time to contribute!

 

Doc is here: https://docs.google.com/document/d/1ntdU4q4ZmfX-EyClxKAK6yaikQleg6maSeijDXi_u0c/edit?usp=sharing

 

Kind Regards,

Alex

 

 

Alex Chircop

Founder and CTO

T: +44 7968 948832

E: alex.chircop@...

W: http://storageOS.com

L: uk.linkedin.com/in/alexchircop/

Skype: chira001

 

 

This email and any attachments are confidential to the intended recipient and may also be privileged or copyrighted material.  Any review, retransmission, dissemination or other use of, or taking of any action in reliance upon, this information by persons or entities other than the intended recipient is prohibited.  If you are not the intended recipient please delete it from your system and notify the sender.
StorageOS Ltd is a company registered in England and Wales with company number 9614942. Registered office address: 2 Minton Place, Victoria Road, Bicester, Oxfordshire, OX26 6QB.

 

 

 

 

 

From: Alex Chircop
Sent: Wednesday, February 1, 2017 3:50 PM
To: cncf-toc@...
Subject: Storage Patterns for container native - community content

 

Hi,

 

Following the discussion at the last TOC call, I’m attaching a doc to cover the topics that we are volunteering to generate for the community.   As background, we are proposing to focus this series on storage related patterns, starting with an overview and moving onto more complex use cases and examples.   We are planning to generate roughly an article a week on average for around ~3 months.

                                                  

I’m keen to understand if this is in line with what you think would be useful to the community and would be interested in any feedback and comments.   We would obviously be more than happy to work with anyone else who might be interested in contributing and/or any opportunity for joint work on any of the topics.

 

Doc is here: https://docs.google.com/document/d/14vVawyRcRRPm_mGZfl-tpQDCq2Q9aWxeHgdpZLAWnzU

 

Kind Regards,

Alex

 

 

Alex Chircop

Founder and CTO

T: +44 7968 948832

E: alex.chircop@...

W: http://storageOS.com

L: uk.linkedin.com/in/alexchircop/

Skype: chira001

 

 

This email and any attachments are confidential to the intended recipient and may also be privileged or copyrighted material.  Any review, retransmission, dissemination or other use of, or taking of any action in reliance upon, this information by persons or entities other than the intended recipient is prohibited.  If you are not the intended recipient please delete it from your system and notify the sender.StorageOS Ltd is a company registered in England and Wales with company number 9614942. Registered office address: 2 Minton Place, Victoria Road, Bicester, Oxfordshire, OX26 6QB.

 


_______________________________________________
cncf-toc mailing list
cncf-toc@...
https://lists.cncf.io/mailman/listinfo/cncf-toc



_______________________________________________
cncf-toc mailing list
cncf-toc@...
https://lists.cncf.io/mailman/listinfo/cncf-toc




--
Chris Aniszczyk (@cra) | +1-512-961-6719
_______________________________________________
cncf-toc mailing list
cncf-toc@...
https://lists.cncf.io/mailman/listinfo/cncf-toc
--
+31 652134960
Marketing Chair www.cncf.io

Join {cncf-toc@lists.cncf.io to automatically receive all group messages.