Please take note:
The contracted, casual form of the verb-phrase “would have” is “would’ve.” It is not “would of.”
“I would’ve gone to the store, but it’d already closed.” <— correct
“I would, of late, leave work early to get to the store before it closed.” <— horribly pretentious, but more or less correct
“I would of gone to the store…” <— Stop right there. Please. Just stop.
Thank you. We now return you to your regularly scheduled programming.