1. Parallel Computing Basics

• 1.1. Modern Computer Architecture
  • CPU
  • Network Interface Card
  • Heterogeneous Computing
• 1.2. Serial Execution v.s. Parallel Execution
• 1.3. Threads and Processes
  • Processes and Threads
  • Thread Safety
  • Global Interpreter Lock
• 1.4. Parallel Programming Design Methods
  • PCAM
  • Partitioning Methods
  • Case Study: MapReduce
• 1.5. Performance Metrics
  • FLOPS
  • Speedup Ratio