Log in

No account? Create an account
February 10th, 2007 - Adventures in Engineering — LiveJournal
The wanderings of a modern ronin.

Ben Cantrick
  Date: 2007-02-10 13:47
  Subject:   Software proverbs.
  Tags:  digg, programming

We know about as much about software quality problems as they knew about the Black Plague in the 1600s. We've seen the victims' agonies and helped burn the corpses. We don't know what causes it; we don't really know if there is only one disease. We just suffer - and keep pouring our sewage into our water supply.

- Tom Van Vleck

2 Comments | Post A Comment | | Link

Ben Cantrick
  Date: 2007-02-10 23:23
  Subject:   Message Passing vs Shared Transational Memory: Not mutually exclusive.
  Tags:  parallel computing, programming, reddit

The problem is that everything needs to be parallelized. But being distributed isn’t quite as big an issue. What’s driving the sudden obsession with parallelization is the sudden appearance of multicore chips. But notice something about the multicore chips- how close the CPUs are to each other. Often they even share cache. If two processes can share a data structure by just sharing a pointer to the datastructure, communication speeds are nearly infinite. This allows for multithreaded programs that have incredibly huge communication requirements. Tightly coupled programs are possible in this environment.

I actually think that a lot of problems will be ameniable to both levels approaches. Do message passing, ala MPI or Erlang, at the top level, breaking the problem up into big chunks which can then be distributed over a local network or a highly non-uniform ccNUMA architecture. But then each chunk is solved in a microthread+STM approach, allowing for good utilization of local resources and tightly coupled parallel processes.


See also, The Landscape of Parallel Computing Research: A View from Berkeley
1 Comment | Post A Comment | | Link

May 2015