RSXMB_DELETE_MESSAGES job deletes only ABAP stackmessages .
If any message failed due to mapping error or any other reason first you need to cancel them manually then only these message are eligible to delete it from tables.
Run deletion job peroidically to delete old messages .