You didn't forget the keys, ?

The statement is negative, so the tag should be positive. The verb is 'did forget' (past simple), so the tag uses 'did'. The subject is 'you'.
Answer: did you