Coastguards were called by a concerned friend of the man at around 2pm on Saturday.
The man is believed to have gone kayaking without a life jacket dressed only in his pants, according to a Swansea Coastguard spokesman.
He was also said to be inexperienced.
Hundreds of people enjoying the weekend sunshine at the beach watched on as a dramatic rescue unfolded in front of them.
Two local boats closer to the scene than the coastguard helped in the rescue.
The man was taken to the shore unconscious and was airlifted to Morriston Hospital.
His condition is unknown.
*Were you there? Do you have pictures of the rescue? Call us on 01792 514606