Plaques on historic landmarks have gone missing in addition to two church bells that were eventually recovered.