Alliteration in the Twelve Days of Christmas!
The Swan refers to the astronomical constellation "Cygnus," which is shaped like a cross. It is also known as the Northern Cross.
A swimming swan is the perfect image of the Church at peace.
There are also seven sacraments, so the seven swans a swimming could be referencing that also.