The first Church of God revival held in this community was in a "brush arbor" on the old Mary's Grove School yard in the summer of 1930. Later that year, the Bellview Community united in a mutual effort to construct a church building just north of Bellview School. The community donated land, labor, and material and the building was soon erected. This building had no electric facilities or inside plumbing. Sawdust covered the floor. However in 1936, all facilities were added, even a concrete floor.

In 1948, the state of Tennessee built a new four lane highway from Fayetteville to Huntsville. The church decided to re-locate to a more desirable location. Many members gave time, labor, money, and materials for the construction of the new church building. Some members even took leave from their regular jobs and devoted themselves full-time to this project. The first service was held on the first Sunday of September in 1950. This new congregation was named the Harmony Hill Church of God. 

A parsonage was later built in 1955. The congregation purchased some additional property in 1960. In 1973, this additional property was sold to pay for a complete remodeling of the church building, with the addition of a new educational wing and modifications to the parsonage. 

Today Harmony Hill Church of God sits on a beautiful hillside overlooking the rolling hills of South Central Tennessee on one side and a bustling four-lane highway on the other. Over the years a good size rural-suburban community has developed a challenging potential for the congregation.