Grampians residents are slowly returning to their homes as bushfire warnings across Victoria have been downgraded.