The occasional lack of efficiency/productivity should be reflected in your billable rate, that is, the rate should reflect your level of (relevant) skill, any specialized knowledge, and mean productivity, not max.

Then there is no problem with just billing the spent hours without any fudging one way or the other.