3. He usually had dinner at 4 p.m., ... ?

This is a tag question. The main clause is in the simple past ('had'). The tag question should use the auxiliary verb 'did' with the subject 'he'. Therefore, 'didn't he' is the correct choice.