On the edit-buttonbar is the button to delete the current note or item the cursor is pointing to. Use undo to get the note back after deletion.
The usual shortcut fort delete is de <delete> key. As you might have been expecting the <backspace> key will perform a delete for the object left from the cursor.