Parallel-computing

Home
wikipedia-Parallel-computing
wikipedia-Parallel-computing
- Introduction
Concurrent-computing
Concurrent-computing
- Concurrent-computing
- Books
- Expert-Jeff-Preshing
  Expert-Jeff-Preshing
  - Introduction
  - Performance
    Performance
    
    The-Cost-of-Enabling-Exception-Handling
    The-Cost-of-Enabling-Exception-Handling
    
    Introduction
  - Multithread
    Multithread
    
    Introduction
    
    01-Locks-Aren't-Slow-Lock-Contention-Is
    01-Locks-Aren't-Slow-Lock-Contention-Is
    
    Introduction
    
    02-Always-Use-a-Lightweight-Mutex
    02-Always-Use-a-Lightweight-Mutex
    
    Introduction
    
    03-A-C++Profiling-Module-for-Multithreaded-APIs
    03-A-C++Profiling-Module-for-Multithreaded-APIs
    
    Introduction
    
    04-A-Look-Back-at-Single-Threaded-CPU-Performance
    04-A-Look-Back-at-Single-Threaded-CPU-Performance
    
    Introduction
    
    05-Roll-Your-Own-Lightweight-Mutex
    05-Roll-Your-Own-Lightweight-Mutex
    
    Introduction
    
    Benaphore
    Benaphore
    
    Introduction
    
    06-Implementing-a-Recursive-Mutex
    06-Implementing-a-Recursive-Mutex
    
    Introduction
    
    07-Lightweight In-Memory Logging
    07-Lightweight In-Memory Logging
    
    Introduction
  - Hash-map
    Hash-map
    
    Introduction
    
    Hash-Collision-Probabilities
    Hash-Collision-Probabilities
    
    Introduction
    
    Hash-Table-Performance-Tests
    Hash-Table-Performance-Tests
    
    Introduction
  - Lock-Free-Programming
    Lock-Free-Programming
    
    Introduction
    
    02-Memory-Reordering-Caught-in-the-Act
    02-Memory-Reordering-Caught-in-the-Act
    
    Introduction
    
    gcc-source-code
    
    03-An-Introduction-to-Lock-Free-Programming
    03-An-Introduction-to-Lock-Free-Programming
    
    Introduction
    
    04-Memory-Ordering-at-Compile-Time
    04-Memory-Ordering-at-Compile-Time
    
    Introduction
    
    05-Memory-Barriers-Are-Like-Source-Control-Operations
    05-Memory-Barriers-Are-Like-Source-Control-Operations
    
    Introduction
    
    06-Acquire-and-Release-Semantics
    06-Acquire-and-Release-Semantics
    
    Introduction
    
    07-Weak-vs-Strong-Memory-Models
    07-Weak-vs-Strong-Memory-Models
    
    Introduction
    
    08-This-Is-Why-They-Call-It-a-Weakly-Ordered-CPU
    08-This-Is-Why-They-Call-It-a-Weakly-Ordered-CPU
    
    Introduction
    
    09-Atomic-vs-Non-Atomic-Operations
    09-Atomic-vs-Non-Atomic-Operations
    
    Introduction
    
    10-The-Happens-Before-Relation
    10-The-Happens-Before-Relation
    
    Introduction
    
    11-The-Synchronizes-With-Relation
    11-The-Synchronizes-With-Relation
    
    Introduction
    
    12-Acquire-and-Release-Fences
    12-Acquire-and-Release-Fences
    
    Introduction
    
    13-Double-Checked-Locking-is-Fixed-In-C++11
    13-Double-Checked-Locking-is-Fixed-In-C++11
    
    Introduction
    
    14-Acquire-and-Release-Fences-Don’t-Work-the-Way-You’d-Expect
    14-Acquire-and-Release-Fences-Don’t-Work-the-Way-You’d-Expect
    
    Introduction
    
    15-The-Purpose-of-memory_order_consume-in-C++11
    15-The-Purpose-of-memory_order_consume-in-C++11
    
    Introduction
    
    16-You-Can-Do-Any-Kind-of-Atomic-Read-Modify-Write-Operation
    16-You-Can-Do-Any-Kind-of-Atomic-Read-Modify-Write-Operation
    
    Introduction
  - TODO-Preshing-Safe-Bitfields-in-C++
    TODO-Preshing-Safe-Bitfields-in-C++
    
    Introduction
  - TODO-Preshing-Semaphores-are-Surprisingly-Versatile
    TODO-Preshing-Semaphores-are-Surprisingly-Versatile
    
    Introduction
  - Library-cpp11-on-multicore
    Library-cpp11-on-multicore
    
    Introduction
    
    Read-code
    Read-code
    
    Introduction
    
    inmemorylogger
    inmemorylogger
    
    Introduction
- Expert-iter_zc
  Expert-iter_zc
  - Introduction
  - CSDN-聊聊高并发-5-理解缓存一致性协议以及对并发编程的影响
    CSDN-聊聊高并发-5-理解缓存一致性协议以及对并发编程的影响
    
    Introduction
  - CSDN-聊聊高并发-6-实现几种自旋锁一
    CSDN-聊聊高并发-6-实现几种自旋锁一
    
    Introduction
  - CSDN-聊聊高并发-7-实现几种自旋锁二
    CSDN-聊聊高并发-7-实现几种自旋锁二
    
    Introduction
- Expert-1024cores
  Expert-1024cores
  - Introduction
  - Lockfree-Algorithms
    Lockfree-Algorithms
    
    Lockfree-Algorithms
    
    TODO-Introduction
    TODO-Introduction
    
    Introduction
    
    TODO-Producer-Consumer-Queues
    TODO-Producer-Consumer-Queues
    
    Introduction
    
    TODO-Lazy-Concurrent-Initialization
    TODO-Lazy-Concurrent-Initialization
    
    Introduction
- Expert-Cameron
  Expert-Cameron
  - Introduction
  - Library-readerwriterqueue
    Library-readerwriterqueue
    
    Introduction
  - Library-concurrentqueue
    Library-concurrentqueue
    
    Introduction
- Course-tau-Multiprocessor-Programming-CS-0368-4061-01
  Course-tau-Multiprocessor-Programming-CS-0368-4061-01
  - Introduction
- Course-uhcl-Concurrency
  Course-uhcl-Concurrency
  - Introduction
- Concurrency-control
  Concurrency-control
  - Introduction
  - Synchronization
    Synchronization
    
    Introduction
  - Lock
    Lock
    
    Introduction
    
    TODO-Mutex
    TODO-Mutex
    
    Introduction
    
    Linux-Seqlock
    Linux-Seqlock
    
    Introduction
    
    Read–write-lock
    Read–write-lock
    
    Introduction
    
    Spinlock
    Spinlock
    
    Introduction
    
    Spinning-lock-optimization
    Spinning-lock-optimization
    
    Introduction
    
    paper-Algorithms-for-Scalable-Synchronization
    paper-Algorithms-for-Scalable-Synchronization
    
    Introduction
    
    paper-Spinlock-with-timeout
    paper-Spinlock-with-timeout
    
    Introduction
    
    paper
    paper
    
    Introduction
    
    Ticket-lock
    Ticket-lock
    
    Introduction
    
    library-geidav-spinlocks-bench
    library-geidav-spinlocks-bench
    
    Introduction
    
    library-honkiko-Multi-Core-Toolbox
    library-honkiko-Multi-Core-Toolbox
    
    Introduction
    
    library-bogachevdmitry-CLHLock
    library-bogachevdmitry-CLHLock
    
    Introduction
    
    Double-checked-locking
    Double-checked-locking
    
    Introduction
    
    TODO-Hand-over-hand-lock
    TODO-Hand-over-hand-lock
    
    Introduction
    
    Disadvantage
    Disadvantage
    
    Introduction
    
    Deadlock-and-livelock
    Deadlock-and-livelock
    
    Introduction
    
    Starvation
    Starvation
    
    Introduction
    
    Granularity-of-lock
    Granularity-of-lock
    
    Introduction
    
    Evaluation-metric
    Evaluation-metric
    
    Introduction
  - Barrier
    Barrier
    
    Introduction
  - Non-blocking
    Non-blocking
    
    Introduction
    
    TODO-Level-of-free
    TODO-Level-of-free
    
    Introduction
    
    Liveness
    Liveness
    
    Introduction
    
    Lock-free
    Lock-free
    
    Introduction
    
    Primer
    Primer
    
    microsoft-Lockless-Programming-Considerations-for-Xbox-360-and-Microsoft-Windows
    microsoft-Lockless-Programming-Considerations-for-Xbox-360-and-Microsoft-Windows
    
    Introduction
    
    Atomic-operation
    Atomic-operation
    
    Introduction
    
    Atomic-instruction
    
    Memory-barrier
    Memory-barrier
    
    Introduction
    
    Copy-on-write
    Copy-on-write
    
    Introduction
    
    wikipedia-Copy-on-write
    
    Memory-reclamation
    Memory-reclamation
    
    Introduction
    
    cs.toronto-Comparative-Performance-of-Memory-Reclamation-Strategies
    cs.toronto-Comparative-Performance-of-Memory-Reclamation-Strategies
    
    Introduction
    
    Quiescent-state-based-reclamation-QSBR
    Quiescent-state-based-reclamation-QSBR
    
    Introduction
    
    Epoch-Based-Reclamation-EBR
    Epoch-Based-Reclamation-EBR
    
    Introduction
    
    Hazard-pointer-based reclamation-HPBR
    Hazard-pointer-based reclamation-HPBR
    
    Introduction
    
    TODO-Hazard-pointer
    TODO-Hazard-pointer
    
    Introduction
    
    preshing-Using-Quiescent-States-to-Reclaim-Memory
    preshing-Using-Quiescent-States-to-Reclaim-Memory
    
    Introduction
    
    Read-copy-update
    Read-copy-update
    
    Introduction
    
    lwn-User-space-RCU
    lwn-User-space-RCU
    
    Introduction
    
    Version-based
    Version-based
    
    Introduction
    
    MVCC
    MVCC
    
    Introduction
    
    Timestamp-based-concurrency-control
  - Transactional-memory
    Transactional-memory
    
    Introduction
  - Optimistic-and-pessimistic
    Optimistic-and-pessimistic
    
    Introduction
    
    zhihu-你了解乐观锁和悲观锁吗
    zhihu-你了解乐观锁和悲观锁吗
    
    Introduction
  - Non-blocking-VS-blocking
    Non-blocking-VS-blocking
    
    Introduction
    
    Lock-free-VS-lock-based
    Lock-free-VS-lock-based
    
    Introduction
- Classic-problem
  Classic-problem
  - Introduction
  - Producer–consumer-problem
    Producer–consumer-problem
    
    Introduction
    
    Unbounded-producer-and-consumer-problem
  - Readers–writers-problem
    Readers–writers-problem
    
    Introduction
  - Dining-philosopher
    Dining-philosopher
    
    Introduction
    
    mariusbancila-Dining-philosopher
    mariusbancila-Dining-philosopher
    
    Introduction
    
    Chandy-Misra-algorithm
    Chandy-Misra-algorithm
    
    Introduction
    
    TODO-howardhinnant-Dining-Philosophers-Rebooted
    TODO-howardhinnant-Dining-Philosophers-Rebooted
    
    Introduction
  - Checkpoint-Synchronization
    Checkpoint-Synchronization
    
    Introduction
  - Sleeping-barber-problem
    Sleeping-barber-problem
    
    Introduction
  - Cigarette-smokers-problem
    Cigarette-smokers-problem
    
    Introduction
- Concurrent-data-structure
  Concurrent-data-structure
  - Introduction
  - Queue
    Queue
    
    Introduction
    
    TODO-paper-obstruction-free synchronization-double-ended-queues
    TODO-paper-obstruction-free synchronization-double-ended-queues
    
    Introduction
    
    TODO-paper-wait-free-queue-with-multiple-enqueuers-and-dequeuers
    TODO-paper-wait-free-queue-with-multiple-enqueuers-and-dequeuers
    
    Introduction
    
    Circular-queue
    Circular-queue
    
    Introduction
  - Hash-table
    Hash-table
    
    Introduction
  - Linked-list
    Linked-list
    
    Introduction
  - Collection-library
    Collection-library
    
    Introduction
    
    Library-libcds
    Library-libcds
    
    Introduction
    
    Library-libcds
  - Course-Practical-lock-free-data-structures
    Course-Practical-lock-free-data-structures
    
    Introduction
    
    paper-Concurrent-Programming-Without-Locks
    paper-Concurrent-Programming-Without-Locks
    
    Introduction
    
    paper-Non-blocking-hashtables-with-open-addressing
    paper-Non-blocking-hashtables-with-open-addressing
    
    Introduction
  - TODO-simongui-Improving-performance-of-lockless-data-structures
    TODO-simongui-Improving-performance-of-lockless-data-structures
    
    Introduction
- Design-and-optimize
  Design-and-optimize
  - Introduction
- 秒杀-流量削峰
  秒杀-流量削峰
  - Introduction
Multithread
Multithread
- Introduction
- Expert-Herb-Sutter
  Expert-Herb-Sutter
  - Introduction
  - 01-The-Pillars-of-Concurrency
    01-The-Pillars-of-Concurrency
    
    Introduction
  - 02-How-Much-Scalability-Do-You-Have-or-Need
    02-How-Much-Scalability-Do-You-Have-or-Need
    
    Introduction
  - 06-Use-Lock-Hierarchies-to-Avoid-Deadlock
    06-Use-Lock-Hierarchies-to-Avoid-Deadlock
    
    Introduction
  - 07-TODO-Break-Amdahl's-Law
    07-TODO-Break-Amdahl's-Law
    
    Introduction
  - 11-Maximize-Locality-Minimize-Contention
    11-Maximize-Locality-Minimize-Contention
    
    Introduction
  - 12-Choose-Concurrency-Friendly-Data-Structures
    12-Choose-Concurrency-Friendly-Data-Structures
    
    Introduction
  - 15-TODO-Writing-Lock-Free-Code-A-Corrected-Queue
    15-TODO-Writing-Lock-Free-Code-A-Corrected-Queue
    
    Introduction
  - 20-TODO-Sharing-Is-the-Root-of-All-Contention
    20-TODO-Sharing-Is-the-Root-of-All-Contention
    
    Introduction
  - 31-Prefer-Using-Active-Objects-Instead-of-Naked-Thread
    31-Prefer-Using-Active-Objects-Instead-of-Naked-Thread
    
    Introduction
- Thread-safety
  Thread-safety
  - Introduction
  - What-cause-unsafety
    What-cause-unsafety
    
    Introduction
    
    Race
    Race
    
    Introduction
    
    stackoverflow-What-is-a-race-condition
    stackoverflow-What-is-a-race-condition
    
    Introduction
    
    wikipedia-Race-condition
    wikipedia-Race-condition
    
    Introduction
    
    TODO-Increment-operator
    TODO-Increment-operator
    
    Introduction
    
    Time-of-check-to-time-of-use
    Time-of-check-to-time-of-use
    
    Introduction
    
    wikipedia-Time-of-check-to-time-of-use
    wikipedia-Time-of-check-to-time-of-use
    
    Introduction
    
    Out-of-order-execution&&memory-reorder
    Out-of-order-execution&&memory-reorder
    
    Introduction
    
    acmqueue-Shared-Variables-or-Memory-Models
    acmqueue-Shared-Variables-or-Memory-Models
    
    Introduction
  - wikipedia-Thread-safety
    wikipedia-Thread-safety
    
    Introduction
- Lifetime
  Lifetime
  - Introduction
  - Creation
    Creation
    
    Introduction
  - Termination
    Termination
    
    Introduction
- Inter-thread-communication
  Inter-thread-communication
  - Introduction
  - Condition-variables-VS-mutex
    Condition-variables-VS-mutex
    
    Introduction
- Topics
  Topics
  - Sleep-forever
    Sleep-forever
    
    Introduction
  - Execute-once
    Execute-once
    
    Introduction
  - Stop-a-blocked-thread
    Stop-a-blocked-thread
    
    Introduction
  - Wait-VS-sleep
    Wait-VS-sleep
    
    Introduction
  - Stop-a-sleeping-thread
    Stop-a-sleeping-thread
    
    Introduction
  - False-death
    False-death
    
    Introduction
  - Thread-pool
    Thread-pool
    
    Introduction
    
    library-progschj-ThreadPool
    library-progschj-ThreadPool
    
    Introduction
- Thread-model
  Thread-model
  - Introduction
  - TODO-Locate-assign-线程定位
    TODO-Locate-assign-线程定位
    
    Introduction
Distributed-computing
Distributed-computing
- Introduction
- Expert-Leslie-Lamport
  Expert-Leslie-Lamport
  - Introduction
- Expert-Dr-Werner-Vogels
  Expert-Dr-Werner-Vogels
  - Introduction
  - Eventually-Consistent-Revisited
    Eventually-Consistent-Revisited
    
    Introduction
- Course
  Course
  - Course-disco.ethz-Distributed-Systems
    Course-disco.ethz-Distributed-Systems
    
    Introduction
  - Course-Northeastern-University-CS7680
    Course-Northeastern-University-CS7680
    
    Introduction
  - Course-Rutgers-Distributed-Systems
    Course-Rutgers-Distributed-Systems
    
    Introduction
    
    Understanding-Paxos
    Understanding-Paxos
    
    Introduction
- Book-Designing-Data-Intensive-Applications
  Book-Designing-Data-Intensive-Applications
  - Introduction
  - Preface
    Preface
    
    Introduction
  - Outline
    Outline
    
    Introduction
  - PART-I
    PART-I
    
    1-Reliable-Scalable-Maintainable-Applications
    1-Reliable-Scalable-Maintainable-Applications
    
    Introduction
  - PART-II-Distributed-Data
    PART-II-Distributed-Data
    
    PART-II-Distributed-Data
    
    5-Replication
    5-Replication
    
    Introduction
    
    8-The-Trouble-with-Distributed-Systems
    8-The-Trouble-with-Distributed-Systems
    
    CHAPTER-8-The-Trouble-with-Distributed-Systems
- Book-Distributed-systems-for-fun-and-profit
  Book-Distributed-systems-for-fun-and-profit
  - Introduction
  - 4-Replication
    4-Replication
    
    Introduction
- dist-prog-book
  dist-prog-book
  - Introduction
- Guide
  Guide
  - Introduction
  - Distributed-system-challenge
    Distributed-system-challenge
    
    Introduction
  - Abstraction
    Abstraction
    
    Introduction
  - CSDN-悟空讲架构-分布式系列
    CSDN-悟空讲架构-分布式系列
    
    Introduction
    
    01-用三国杀讲分布式算法
    01-用三国杀讲分布式算法
    
    Introduction
    
    02-用太极拳讲分布式理论
    02-用太极拳讲分布式理论
    
    Introduction
    
    03-Paxos共识算法
    03-Paxos共识算法
    
    Introduction
    
    04-Raft共识算法
    04-Raft共识算法
    
    Introduction
    
    05-Consistent-hash
    05-Consistent-hash
    
    Introduction
    
    06-Gossip协议
    06-Gossip协议
    
    Introduction
    
    07-分布式系统的坑
    07-分布式系统的坑
    
    Introduction
    
    08-Quorum-NWR
    08-Quorum-NWR
    
    Introduction
    
    服务雪崩
    服务雪崩
    
    Introduction
  - martinfowler-Patterns-of-Distributed-Systems
    martinfowler-Patterns-of-Distributed-Systems
    
    Introduction
- Theory
  Theory
  - Introduction
  - CAP
    CAP
    
    Introduction
  - Consistency
    Consistency
    
    Introduction
    
    Primer
    Primer
    
    Introduction
    
    wikipedia-Consistency-model
    wikipedia-Consistency-model
    
    Introduction
    
    Classification
    Classification
    
    Strong-consistency
    Strong-consistency
    
    Introduction
    
    Linearizability
    Linearizability
    
    Introduction
    
    TODO-Sequential-consistency-VS-linearizability
    
    Sequential-consistency
    Sequential-consistency
    
    Introduction
    
    Weak-consistency
    Weak-consistency
    
    Introduction
    
    Eventual-consistency
    Eventual-consistency
    
    Introduction
    
    Causal-consistency
    Causal-consistency
    
    Introduction
    
    NRW-quorum-consistency
    NRW-quorum-consistency
    
    Introduction
    
    Data-consistency
    Data-consistency
    
    Introduction
  - High-availability
    High-availability
    
    Introduction
    
    Single-point-of-failure
    Single-point-of-failure
    
    Introduction
    
    High-availability-cluster
    High-availability-cluster
    
    Introduction
    
    Replication
    Replication
    
    Introduction
    
    State-machine-replication
    State-machine-replication
    
    Introduction
    
    Conflict-free-replicated-data-type
    Conflict-free-replicated-data-type
    
    Introduction
    
    多活-双活
    多活-双活
    
    Introduction
  - Network-partition
    Network-partition
    
    Introduction
  - Fault-tolerance
    Fault-tolerance
    
    Introduction
    
    Byzantine-Fault-Tolerance
    Byzantine-Fault-Tolerance
    
    Introduction
  - Consensus
    Consensus
    
    Introduction
    
    Quorum
    Quorum
    
    Introduction
    
    Leader-election
    Leader-election
    
    Introduction
    
    VS-consensus-VS-consistency
  - Time&Ordering
    Time&Ordering
    
    Introduction
    
    Logical-clock
    Logical-clock
    
    Introduction
    
    wikipedia-Logical-clock
    wikipedia-Logical-clock
    
    Introduction
    
    Lamport-timestamp
    Lamport-timestamp
    
    Introduction
    
    paper-Time-Clocks-and-the-Ordering-of-Events-in-a-Distributed-System
    paper-Time-Clocks-and-the-Ordering-of-Events-in-a-Distributed-System
    
    Introduction
    
    Happened-before
    Happened-before
    
    Introduction
    
    Vector-clock
    Vector-clock
    
    Introduction
    
    Version-vector
    Version-vector
    
    Introduction
  - Protocol
    Protocol
    
    Guide
    Guide
    
    Introduction
    
    Expert-范斌
    Expert-范斌
    
    Introduction
    
    漫话分布式系统共识协议2PC-3PC篇
    漫话分布式系统共识协议2PC-3PC篇
    
    Introduction
    
    漫话分布式系统共识协议Paxos篇
    漫话分布式系统共识协议Paxos篇
    
    Introduction
    
    一致性协议算法-2PC-3PC-Paxos-Raft-ZAB-NWR
    一致性协议算法-2PC-3PC-Paxos-Raft-ZAB-NWR
    
    Introduction
    
    csdn-分布式一致性协议
    csdn-分布式一致性协议
    
    Introduction
    
    CSDN-分布式基础通信协议paxos-totem-gossip
    CSDN-分布式基础通信协议paxos-totem-gossip
    
    Introduction
    
    2PC
    2PC
    
    Introduction
    
    3PC
    3PC
    
    Introduction
    
    Paxos
    Paxos
    
    Introduction
    
    paper-Paxos-Made-Simple
    paper-Paxos-Made-Simple
    
    Introduction
    
    wikipedia-Paxos
    wikipedia-Paxos
    
    Introduction
    
    Multi-paxos
    Multi-paxos
    
    Introduction
    
    cnblogs-使用multi-paxos实现日志同步应用
    cnblogs-使用multi-paxos实现日志同步应用
    
    Introduction
    
    CSDN-重要的Paxos算法你看透了么
    CSDN-重要的Paxos算法你看透了么
    
    Introduction
    
    Raft
    Raft
    
    Introduction
    
    paper-In-Search-of-an-Understandable-Consensus-Algorithm
    paper-In-Search-of-an-Understandable-Consensus-Algorithm
    
    Introduction
    
    github-The-Raft-Consensus-Algorithm
    github-The-Raft-Consensus-Algorithm
    
    Introduction
    
    wikipedia-Raft
    wikipedia-Raft
    
    Introduction
    
    Gossip
    Gossip
    
    Introduction
    
    wikipedia-Gossip-protocol
    wikipedia-Gossip-protocol
    
    Introduction
  - Split-brain
    Split-brain
    
    Introduction
- Technique
  Technique
  - Introduction
  - Heartbeat
    Heartbeat
    
    Introduction
  - Distributed-transaction
    Distributed-transaction
    
    Introduction
  - Rendezvous
    Rendezvous
    
    Introduction
- Architecture
  Architecture
  - Introduction Introduction
    Table of contents
    
    Client-server VS peer-to-peer
    
    TODO P2P VS shared nothing architecture
    
    Centralized VS Decentralized
  - Client–server-architecture
    Client–server-architecture
    
    Introduction
  - Peer-to-peer-architecture
    Peer-to-peer-architecture
    
    Introduction
  - Shared-nothing-architecture
    Shared-nothing-architecture
    
    Introduction
Scalability
Scalability
- Introduction
Model
Model
- Introduction
- Multiple-model
  Multiple-model
  - Introduction
  - Shared-data
    Shared-data
    
    Introduction
    
    TODO-Shared-memory
    TODO-Shared-memory
    
    Introduction
    
    Shared-resource
    Shared-resource
    
    Introduction
  - Contention-and-race
    Contention-and-race
    
    Introduction
    
    Resource-contention
    Resource-contention
    
    Introduction
  - Read-and-write
    Read-and-write
    
    Introduction
- Fork–join-model
  Fork–join-model
  - Introduction
- Stream-model
  Stream-model
  - Introduction
- Communicating-Sequential-Processes
  Communicating-Sequential-Processes
  - Introduction
Programming-model
Programming-model
- Introduction
- Active-and-passive
  Active-and-passive
  - Introduction
  - Polling
    Polling
    
    Introduction
  - Busy-waiting
    Busy-waiting
    
    Introduction
  - Polling-and-notify
- TODO-MapReduce
  TODO-MapReduce
  - Introduction
- Blocking-and-synchronous
  Blocking-and-synchronous
  - Introduction
- Blocking-and-non-blocking
  Blocking-and-non-blocking
  - Introduction
- Sync-and-async
  Sync-and-async
  - Introduction
  - Asynchronous-programming
    Asynchronous-programming
    
    Introduction
    
    Coroutine-async-await
    Coroutine-async-await
    
    Introduction
    
    Coroutine
    Coroutine
    
    Introduction
    
    Promise-future
    Promise-future
    
    Introduction
    
    Future-promise-VS-observer-pattern-VS-callback
- API
  API
  - Introduction
  - Threading-Building-Blocks
    Threading-Building-Blocks
    
    Introduction
  - OpenMP
    OpenMP
    
    Introduction
  - Cilk
    Cilk
    
    Introduction
Event-driven-concurrent-server
Event-driven-concurrent-server
- Introduction
- Event-driven-model
  Event-driven-model
  - Introduction
  - What-is-event-driven-model
    What-is-event-driven-model
    
    Introduction
    
    Monitor-notify-dispatch
    Monitor-notify-dispatch
    
    Introduction
  - Event-loop
    Event-loop
    
    Event-loop
    
    Implementation
  - Event-passing
    Event-passing
    
    Introduction
  - Event-VS-exception-VS-signal
- Event-library
  Event-library
  - Introduction
  - library-Netty
    library-Netty
    
    Introduction
  - library-libevent
    library-libevent
    
    Introduction
  - library-libuv
    library-libuv
    
    Introduction
    
    Design-overview
    Design-overview
    
    Introduction
    
    User-guide
    User-guide
    
    Basics-of-libuv
    Basics-of-libuv
    
    Introduction
  - library-muduo
    library-muduo
    
    Introduction
- Concurrent-server
  Concurrent-server
  - Introduction
  - Case
    Case
    
    Introduction
    
    HTTP-server
    HTTP-server
    
    Introduction
  - C10K-problem
    C10K-problem
    
    Introduction
    
    kegel-Unix-The-C10K-problem
    kegel-Unix-The-C10K-problem
    
    Introduction
  - Load-balance
    Load-balance
    
    Introduction
    
    Round-robin
    Round-robin
    
    Introduction
  - developer.51cto-支撑亿级高并发的系统长啥样
    developer.51cto-支撑亿级高并发的系统长啥样
    
    Introduction
- Expert-Nick-Black
  Expert-Nick-Black
  - Introduction
  - Fast-UNIX-Servers
    Fast-UNIX-Servers
    
    Introduction
  - library-libtorque
    library-libtorque
    
    Introduction
- Expert-Jeff-Darcy
  Expert-Jeff-Darcy
  - Introduction
  - High-Performance-Server-Architecture
    High-Performance-Server-Architecture
    
    Introduction
- Design-pattern
  Design-pattern
  - Introduction
  - Asynchronous-method-dispatch
  - Observer-pattern
    Observer-pattern
    
    Introduction
    
    Code
    Code
    
    Introduction
    
    Lapsed-listener-problem
    Lapsed-listener-problem
    
    Introduction
  - Active-object+observer+visitor
    Active-object+observer+visitor
    
    Introduction
    
    drdobbs-Message-Handling-Without-Dependencies
    drdobbs-Message-Handling-Without-Dependencies
    
    Introduction
  - Proactor-reactor
    Proactor-reactor
    
    Introduction
    
    zhihu-如何深刻理解reactor和proactor
    zhihu-如何深刻理解reactor和proactor
    
    Introduction
    
    Proactor
    Proactor
    
    Introduction
    
    Reactor
    Reactor
    
    Introduction
  - Actor&&active-object
    Actor&&active-object
    
    Introduction
    
    Actor
    Actor
    
    Introduction
    
    brianstorti-The-actor-model-in-10-minutes
    brianstorti-The-actor-model-in-10-minutes
    
    Introduction
    
    Writing-Concurrent-Programs-Using-F#-Mailbox-Processors
    Writing-Concurrent-Programs-Using-F#-Mailbox-Processors
    
    Introduction
    
    Active-object
    Active-object
    
    Introduction
    
    Asynchronous-method-invocation
    
    Implementation
    Implementation
    
    Introduction
    
    library-syscpp
    library-syscpp
    
    Introduction
    
    rosettacode-Active-object
    
    kjellhedstrom2-Active-Object-the-C++11-way
    kjellhedstrom2-Active-Object-the-C++11-way
    
    Introduction
  - Master-worker
    Master-worker
    
    Introduction
- library-linyacool-WebServer
  library-linyacool-WebServer
  - Introduction
- library-yedf-handy
  library-yedf-handy
  - Introduction
- Apache-Thrift
  Apache-Thrift
  - Introduction
  - paper-Thrift-Scalable-Cross-Language-Services-Implementation
    paper-Thrift-Scalable-Cross-Language-Services-Implementation
    
    Introduction
  - cnblogs-thrift的原理和使用
    cnblogs-thrift的原理和使用
    
    Introduction
  - zhihu-Thrift的那些服务模型
    zhihu-Thrift的那些服务模型
    
    Introduction
- library-POCO
  library-POCO
  - Introduction
  - POCO-PRO-C++framework
    POCO-PRO-C++framework
    
    Introduction
- software-Nginx
  software-Nginx
  - Introduction
  - Concurrency-model
    Concurrency-model
    
    Introduction
    
    zhihu-nginx-master-worker进程工作原理
    zhihu-nginx-master-worker进程工作原理
    
    Introduction
    
    blog-Inside-NGINX-How-We-Designed-for-Performance-&-Scale
    blog-Inside-NGINX-How-We-Designed-for-Performance-&-Scale
    
    Introduction
    
    Thundering-herd-in-Nginx
    Thundering-herd-in-Nginx
    
    Introduction
    
    Nginx-Socket-Sharding
    Nginx-Socket-Sharding
    
    Introduction
    
    Nginx-accept_mutex-implementation
    Nginx-accept_mutex-implementation
    
    Introduction
    
    Nginx-event-library
    Nginx-event-library
    
    Introduction
  - Nginx-proxy
    Nginx-proxy
    
    Introduction
- Timer
  Timer
  - Introduction
  - Periodic-worker
    Periodic-worker
    
    Introduction
  - Columbia-paper-Hashed-hierarchical-wheel-timer
    Columbia-paper-Hashed-hierarchical-wheel-timer
    
    Introduction
Message-processing-system
Message-processing-system
- Introduction
- Stream-based
  Stream-based
  - Introduction
  - Apache-Flink
    Apache-Flink
    
    Introduction
- Distributed-log-system
  Distributed-log-system
  - Introduction
- Messaging-pattern
  Messaging-pattern
  - Introduction
  - Message-queue
    Message-queue
    
    Introduction
    
    AMQP
    AMQP
    
    Advanced-Message-Queuing-Protocol
    
    Fan-out
    Fan-out
    
    Introduction
  - Pub-sub
    Pub-sub
    
    Introduction
- MQ-library
  MQ-library
  - Introduction
  - library-Rabbitmq
    library-Rabbitmq
    
    AMQP-0-9-1-Model-Explained
  - library-ZeroMQ
    library-ZeroMQ
    
    ZeroMQ
  - Apache-Kafka
    Apache-Kafka
    
    Introduction
- library-Celery
  library-Celery
  - Introduction
- Message-disorder
  Message-disorder
  - Introduction
Distributed-data-store
Distributed-data-store
- Introduction
- Data-Sharding-Strategy
  Data-Sharding-Strategy
  - Introduction
  - Consistent-hashing
    Consistent-hashing
    
    Introduction
    
    cnblogs-一致性Hash的原理和实践
    cnblogs-一致性Hash的原理和实践
    
    Introduction
    
    toptal-A-Guide-to-Consistent-Hashing
    toptal-A-Guide-to-Consistent-Hashing
    
    Introduction
  - Rendezvous-hashing
    Rendezvous-hashing
    
    Introduction
  - TODO-Consistent-hash-VS-rendezvous-hash
- Distributed-hash-table
  Distributed-hash-table
  - Introduction
  - wikipedia-Distributed-cache
- Distributed-database
  Distributed-database
  - Introduction
  - Google-Spanner
    Google-Spanner
    
    Introduction
    
    paper-Spanner-Google’s-Globally-Distributed-Database
    paper-Spanner-Google’s-Globally-Distributed-Database
    
    Introduction
  - YugabyteDB
    YugabyteDB
    
    Introduction
    
    blog-4-Data-Sharding-Strategies-in-Building-Distributed-SQL-Database
    blog-4-Data-Sharding-Strategies-in-Building-Distributed-SQL-Database
    
    Introduction
  - CockroachDB
    CockroachDB
    
    Introduction
    
    Living-Without-Atomic-Clocks
    Living-Without-Atomic-Clocks
    
    Introduction
  - MySQL-Cluster
    MySQL-Cluster
    
    Introduction
  - NewSQL
    NewSQL
    
    Introduction
- Amazon-Dynamo
  Amazon-Dynamo
  - Introduction
- Data-system
  Data-system
  - Schema
    Schema
    
    Introduction
  - Redo-log
    Redo-log
    
    Introduction
  - Transaction-log
    Transaction-log
    
    Introduction
RPC
RPC
- Introduction
- gRPC
  gRPC
  - Introduction
Thundering-herd-problem
Thundering-herd-problem
- Introduction
- Thundering-Herd-in-distributed-computing
  Thundering-Herd-in-distributed-computing
  - Introduction
  - zhihu-分布式系统的Thundering-Herd效应
    zhihu-分布式系统的Thundering-Herd效应
    
    Introduction
- TODO-louqibin-Robinhood-宕机-幕后黑手Thundering-Herd
  TODO-louqibin-Robinhood-宕机-幕后黑手Thundering-Herd
  - Introduction
Application
Application
- Introduction
- Parallel-numeric-processing-system
  Parallel-numeric-processing-system
  - Introduction
  - Dataflow-programming
    Dataflow-programming
    
    Introduction
- Blockchain
  Blockchain
  - Introduction
  - Is-git-a-block-chain
    Is-git-a-block-chain
    
    Introduction
- IPFS
  IPFS
  - Introduction
- NFS
  NFS
  - Network-File-System
software-ZooKeeper
software-ZooKeeper
- Introduction
- Overview
  Overview
  - Introduction
- Developers
  Developers
  - Introduction
  - ZK-client
    ZK-client
    
    Introduction
    
    Java-Apache-Curator
    Java-Apache-Curator
    
    Introduction
    
    Zookeeper-cpp
    Zookeeper-cpp
    
    Introduction
    
    Read-code
    Read-code
    
    Introduction
  - Application
    Application
    
    Introduction
    
    Lead-election
    Lead-election
    
    Introduction
    
    Automatic-failover-using-ZK
    
    Herd-Effect-in-ZK
    Herd-Effect-in-ZK
    
    Introduction
    
    Lock
    Lock
    
    Introduction
- ZAB
  ZAB
  - Introduction
software-Memcached
software-Memcached
- Introduction
- Thread-model
  Thread-model
  - Introduction

Architecture of distributed computing

distributed computing是一个非常宽泛的概念，非常多的架构都可以归入到distributed computing的范轴中。本章梳理这些架构，需要注意的是，架构之间没有优劣之分，只有谁比谁更加适合于具体的问题。

Client-server VS peer-to-peer

Peer-to-peer 和 Client–server 这两种Architectures是 Distributed computing application 最最常见的两种architecture，有必要对这两种architecture进行对比。

在 wikipedia Peer-to-peer 中，一直拿他和 Client–server 进行对比，同样 Client–server 也专门总结了它和 Peer-to-peer 之间的差异。下面梳理一下设计到两者对比的内容的章节：

1、Peer-to-peer

在"Peer-to-peer # Resilient and scalable computer networks"小节中从 single point of failure 中对比了两者。

2、Client–server model

在 Client–server model # Comparison with peer-to-peer architecture中对两者进行了对比。这一段的内容给我的一个重要提示是：Peer-to-peer是 decentralized system，但是Client–server architecture不是centralized system。

除此之外，在一些应用中，也能够看到对这两种架构的比较，比如：

1、git

在Progit book的1.1 Getting Started - About Version Control中就对比了Distributed version control和Centralized version control。

TODO P2P VS shared nothing architecture

我觉得两种的一个共性是: decentralized。

Centralized VS Decentralized

搜罗了一下，维基百科中关于这两者的文章有如下：

上述文章中，Decentralised system是最最通俗易懂的，前两篇质量一般。