A user can delete records that they themselves create. Click Admin Actions > Delete Contact. Then confirm the deletion.
For contacts created via the API, see WP ADMIN > Post Types (D.T) > contacts. Find the record you want to delete and move it to the trash.