The Delete Layer command deletes the active layer from the image.
You can access this command from the image menubar through Layer → Delete Layer.