I have validatation rules for a microsoft access table.  Something is
driving me crazy though.  If somebody starts entering a record (maybe
just hits one too many tabs) it's almost impossible to delete it since
the data validation error boxes pop up when you try to do anything! 
Is there an elegant solution?

It sounds like you might have validation on one or more fields in the
table.  If you start keying something on a new records in a field with
validation and then try to get out of that field (e.g. tab), Access
will keep prompting you.

The easiest thing I know is to use the Escape (Esc) key (after you say
OK or whatever on the popup message box).  The first Esc press
"undoes" the field you are on, making it as if you never went there. 
If you press Esc a second time after that, it will un-do the whole new
record you're entering -- that is sort of like "deleting" the new
record... before it's saved.

The two levels of undo caused by two successive Esc key presses is not
obvious, but quite useful.

Not sure if that's elegant enough for you, but it's my two bits.