I know you said by choice, but my dad is unable to as he passed last year and as a result I had mentioned to uncles that they would give me away instead. Though now I have decided they won't be giving me away either, I haven't told them and I figure if I don't tell them they will just forget so it's sweet
I think in your situation, your dad should expect not to be asked. I don't know the whole story obviously, but if you can't even see your daughter at least once out of a year then you probably don't deserve to walk her down. You say you aren't close, but do you talk much? If so, how often? That could change my thinking.
That being said, I'm on both sides because part of me is thinking maybe this could be a chance for the two of you to get close, iykwim?