I would suggest giving your vet a call and explaining the situation. This sounds like something you should probably have him seen for. The larger pieces could get stuck in his bowels. Plus, if he's still not drinking water, there's always a risk of dehydration.
If it were my dog, I'd at least call for some advice.