The Justices of the Peace of each county shall sit with and assist the County Judge in levying the county taxes, and in making appropriations for the expenses of the county, in the manner to be prescribed by law; and the County Judge, together with a majority of said Justices, shall constitute a quorum for such purposes; and in the absence of the County Judge a majority of the Justices of the Peace may constitute the court, who shall elect one of their number to preside. The General Assembly shall regulate by law the manner of compelling the attendance of such quorum.