Parallel processing is a form of computing in which a number of activities are carried out concurrently on multiple machines so that the time required to solve a given problem is reduced. The advent of low cost high performance Pentium machines and PC based LINUX operating system have attracted many researchers to explore parallel processing experiments on PCs. This chapter provides the complete experience of building a LINUX cluster and its application in mapping some parallel algorithms. This chapter discusses comprehensive procedure of cluster development. It discusses the procedure of linear expansion of a cluster to n nodes. Furthermore, the chapter describes the experience of replacing an existing node if it either fails or needs to be replaced by another powerful node.