So you are looking to expand your knowledge of the middle 1800's? GREAT!
Below are links to many scanned books, ebooks and essays packed full of information to broaden your horizons.
One of the best sources of information concerning the Confederate Government would be members of the Confederate Government, right?
How about the written words of Jefferson Davis himself?
FROM MANASSAS TO APPOMATTOX MEMOIRS OF THE CIVIL WAR IN AMERICA BY JAMES LONGSTREET, LIEUTENANT-GENERAL CONFEDERATE ARMY
Back to Jefferson Davis for a bit. Do you know what all this man did for the US before the war? He was most likely the one who put most of the infrastructure the North used against the South in place...
One General of the Confederacy had a hug impact on the tactics of later wars, Lieutenant General Nathan Bedford Forrest. Many have tried to run this mans reputation through the mud and such but he was above it all. Read about this man and learn the truth. He put everything he had on the line at every turn of his life.
As you can tell, I am really impressed by the Google Books project! It amazes me to see what they have collected in such a short time! So please take a moment and add google books to your favorites and use it as much as you can. There is the Project Gutenberg site also.