This QGIS tutorial explains how to get world shapefile data with country boundaries and also explains how to select each country using their names.