It depends on where you are located.
In Ohio I do not charge sales tax on any baked goods that are not consumed at my premise. So, as long as the client is not sitting at my dining room table eating the cake/cupcake/cookie I just sold them, I don't charge tax.
I do have to charge tax on delivery fees and rental fees since those items are not food.