blog.typeobject.com
Operating Apache Samza at Scale - typeobject
http://blog.typeobject.com/operating-apache-samza-at-scale-1
Laquo; Back to blog. Operating Apache Samza at Scale. This is a repost of an article I wrote for LinkedIn's engineering blog. To see the original, please visit:. Http:/ engineering.linkedin.com/samza/operating-apache-samza-scale. At LinkedIn, we use a log-centric system. To move tons of data around. If you're not familiar with Kafka, you can think of it as a publish-subscribe system that models each message as a log entry. Is up there with Paxos. In terms of understandability. Looks a bit like this:.
belaban.github.io
jgroups-raft by belaban
http://belaban.github.io/jgroups-raft
Implementation of the Raft consensus protocol in JGroups. Download .tar.gz. The jgroups-raft project is a Raft. It is currently in its own repo because it'll move much faster than JGroups and I wanted to have the freedom to release versions in quick succession. Manual: http:/ belaban.github.io/jgroups-raft/manual/index.html. Note that the manual can be generated locally. To do this, check out jgroups-raft and execute. The manual will be generated in the. Is maintained by belaban. Using the Cayman theme.
ozalog.blogspot.com
/var/log/oza.log: Coordination Service(ZooKeeper，etcd ，consul) の比較
http://ozalog.blogspot.com/2014/08/coordination-servicezookeeperetcd-consul.html
Aug 1, 2014. Coordination Service(ZooKeeper，etcd ，consul) の比較. 最近，consul，etcd，ZooKeeper といった，いわゆる Coordination Service(この名前は ZooKeeper. の論文から拝借した)の実装が頻繁に行われている．本記事では，開発が盛んな背景を踏まえた上で，オープンソース実装の Coordination Service の比較を行う． Paxos が Google の手によって Chubby. という形で実用化された後，故障検出 分散合意アルゴリズムを用いた高可用KVSという組み合わせによる Coordination Service のオープンソース実装がいくつが出てきた．そのはしりが ZooKeeper. 65294;その後，しばらく新しい Coordination Service のオープンソース実装はでてきていなかった．それが，2013年に Raft. という分散合意アルゴリズムが公開されて以降，一気に情勢が変わった． consul. ZooKeeper と etcd と consul.
jlordiales.me
Orchestrating your containers with CoreOS, an introduction – Development the way it should be
https://jlordiales.me/2015/07/12/coreos
Professional software developer and scientist. Naturally curious and critical thinker. Orchestrating your containers with CoreOS, an introduction. July 12, 2015. This is the area of orchestration and scheduling of containers, a topic that is extremely hot these days. Particularly with big players in the industry working in new projects to abstract away most of the complexities inherent to running distributed containers. Amazon recently opened up their EC2 container service. To start and manage all these ...
dennyglee.com
Data Engineering Reading Materials: Spark, Machine Learning, and Distributed Systems Resources – Denny Lee
https://dennyglee.com/2015/07/11/data-engineering-reading-materials-spark-machine-learning-and-distributed-systems-resources
Ramblings of a data dork: from BI and Big Data to Travel and Food. Data Engineering Reading Materials: Spark, Machine Learning, and Distributed Systems Resources. Let’s start with Apache Spark (disclosure, I am with Databricks. Machine Learning for Developers. There are some great resources for machine learning for developers including the edX MOOC: Scalable Machine Learning. By Mike de Waard. He does a great explaining Machine Learning concepts in a way for developers to understand. I’m sure there...
linkedbigdata.com
LinkedBigData: October 2014
http://www.linkedbigdata.com/2014_10_01_archive.html
Wednesday, October 29, 2014. Links: October 29, 2014. RICON (distributed systems conference for developers). Simple Binary Encoding (SBE, very effective structured data encoder/decoder for financial systems, faster than Protocol Buffers). Fastsocket (high performance networking Linux kernel patch for multicore machines by SINA.COM). Project Naptha (JavaScript library that can translate and modify OCR-ed text in web images). GopherJS (compiler from Go to JavaScript). Google Material Design Icons.
castro.io
Trading Fish — Raft Leader Election in Consul
https://castro.io/2015/08/13/raft-leader-election-in-consul.html
The blog of Hector Castro. Raft Leader Election in Consul. A small paper reading group has assembled at work. We give ourselves two to three weeks to read a paper, meetup after hours, eat pizza, and discuss it. Our last paper focused on the Raft. Consensus algorithm, and I was chosen to lead the discussion. In order to help the impact of Raft hit closer to home, I put together a small demo. Of Raft’s leader election process using Consul. When servers start up, they begin as followers. A candidate wins an...
blog-ja.intransient.info
Success is a Journey, not a Destination: 5月 2015
http://blog-ja.intransient.info/2015_05_01_archive.html
Success is a Journey, not a Destination. 子供がいると、休日を何もせずのんびり過ごすというのが不可能になり、何かしないといけなくなる。で、今日は Oakland Zoo. に行ってきた。以前に San Francisco Zoo. にもいったことがあるので、この辺（SF 及び北東地域）の Zoo は制覇したことになる。 ふと気になって、動物園の入場料について調べてみた。メインの客は小学生だろうと仮定して、大人の入場料と小学生の入園料は以下のとおり。 SF Zoo: $14.00 / $7.50 （ただし SF 在住の場合。それ以外はもう少し高い）. Oakland Zoo: $15.75 / $11.75. 600 円 / 無料. 600 円 / 無料. 800 円 / 200 円. 2,700 円 / 1,500 円. 65288;日本の動物園のうち、富士サファリパークは私立、他は公立）. まぁ東京都はお金持ちなのでいいとしても、財政危機の横浜のズーラシアは入園料を見直した方が良いのでは・・・。 アメリカで交通事故にあった話（その 2）. そんなにかかるのかーー...
endot.org
Talk Notes: Raft - The Understandable Distributed Protocol - endot
http://endot.org/notes/2014-01-24-raft-the-understandable-distributed-protocol
Eschew obfuscation (and espouse elucidation). Talk Notes: Raft - the Understandable Distributed Protocol. Title: Raft - The Understandable Distributed Protocol Conference: StrangeLoop 2013 Speaker: Ben Johnson Date: 2013-09-20. Http:/ www.infoq.com/presentations/raft. Raft PDF: https:/ ramcloud.stanford.edu/wiki/download/attachments/11370504/raft.pdf. Raft homepage: http:/ raftconsensus.github.io/. A golang implementation of the raft consensus algorithm. Distributed consensus used in:. If a majority of t...
SOCIAL ENGAGEMENT