Are you building a road near your house? I've seen it done in the morning before, but when I tried it, it's really hard to sleep.
I was doing something and I went out at dawn thinking it wouldn't work, but I came back quietly saying it was going down the road... and slept with the window closed...