Introduce LeoFS

1. You can rely on whenever you need.27th July 2012Yosuke HaraJuly 28th, 2012Yosuke Hara 2. We launched LeoFS as OSS on July 4th. LeoFS - http://www.leofs.org 3. Motivation 4. Motivation? NFS - Very Expensive 1. Low ROI 2. Possibility of SPOF 3. Storage Expansion is difficult during increasing data 5. Motivation 762B X 3.5 220B 6. Object Storage Farm 7. Object Storage FarmUnstructured dataS3FS-C 8. Object Storage Farm8 9. Overview 10. LeoFS Overview 11. LeoFS Overview Request from Web Application(s) or BrowserLoad Balancer GatewayManager HTTP LeoFS-ManagerCluster Request/Response Handling S3-API Management +REST over HTTPw/Object CacheRPCRing Watcher LeoFS-Gateway(AWS S3-API)Node Watcher SNMP RPCLeoFS-StorageStorageGUI Console Object Storage, Meta data StorageStorage Engine/Router Storage Engine/Router Storage Engine/Router + METAReplicator/RecovererMETA Object StoreMETAObject StoreObject Store 12. LeoFS Overview Request from Web Application(s)or Browser[Load Balancer] LeoFS-ManagerS3-APIREST over HTTP RPC LeoFS-Gateway SNMP RPCLeoFS-StorageStorage Engine/Router Storage Engine/RouterStorage Engine/Router GUI Console METAObject StoreMETAObject StoreMETA Object Store 13. LeoFS Overview - Example of System layouts Minimum for Service (App) Dev Manager x 1 Gateway x 1Storage x 1 50TB Storage System (# of replicas = 3)XEN, VMWare,... 10TB .. 20TB / server Manager x 2Gateway x 3 ..Storage x 8 - 15 300TB Storage System (# of replicas = 3)XEN, VMWare,... 10TB .. 20TB / server Manager x 2 Gateway x 4 .. Storage x 45 - 90 14. Inside LeoFS 15. LeoFS ArchitectureHTTP Gateway Object Cache Erlang RPC Erlang RPC Storage ClusterErlang RPCProcess Monitor Manager Cluster 16. LeoFS Architecture - Gateway / StorageErlang/OTP RuntimeGatewayREST over HTTP (S3-API) getput delete headredundant-manager membership (fault-detection) RPC Storage redundant-manager replicator read-repairer RPCRPCmembership (fault-detection) queueStorage EngineObject StorageMetadata 17. LeoFS Architecture - Manager Erlang Mnesia RING, Member / Cluster State, AuthProcess Monitor Gateway(s) / Storage Cluster 18. LeoFS Gateway 19. LeoFS Gateway From Applications (Clients) S3-APIGatewayObject Cache Consistent Hashing - Horizontal Distribution Erlang RPC replicate when using RPCStorage Nodes 20. Storage Engine 21. LeoFS Storage EngineRequest From Gateway LeoFS Storagereplicator ...repairer Object StoragequeueMetadata : Keeps an in-memory index of all data.Object Storage : Log structured (append-only) object store. 22. LeoFS Storage Engine - Retrieve an object from the storageLog Structured File SystemLeoFS Storage Engine < META DATA > ID Filename Offset Size Checksum MetadataData HeaderFile FooterObject Container 23. LeoFS Storage Engine - Insert an object into the storage Log Structured File System Add a MetadataMetadataData Append an object 24. LeoFS Storage Engine - Reduce unnecessary objects from the storage Log Structured File SystemCompactionNEW Object ContainerOLD Object Container 25. LeoFS Manager 26. LeoFS ManagerFor Administrators ManagermonitorRING, Node State operatestatus, suspend,resume, detach,whereis, ... 27. Future Works 28. Future Works - Leo Tamer Log Analyzer / Searcher Operation Center 29. Future Works - Integrated HBase with LeoFS “Cloud DWH” = + 30. Wrap Up 31. LeoFS can realize 3-HIGHs - HIGH Cost performance HIGH Reliability HIGH Scalability 32. We set sail for our goal.LeoFS - http://www.leofs.org