What happened sometimes?

Sometimes Mr Brown came back from work very late, when his wife and the child were asleep, and then he opened the front door of his house with his key and came in very quietly.