That's why you wouldn't wait for it to pass. The moment it's in front of your first cannon, you'd begin the broadside. Same as at sea. The trouble is that cannonfire arches, it doesn't stay on a true trajectory. You would have to aim a little above your target, as always, and have quite a lot of power behind it.
[voice]