2. What you (to do) at five o'clock yesterday?

What were you doing at five o'clock yesterday? I was working in the library. I was there too, but I didn't see you.