Alan Graham, a devout Christian and a DUP councillor at the time of the video shoot in 2011, said the media misrepresented the situation and that he and the then 23-year-old artist had parted company on "good terms".
However, he admitted that whenever “I heard this music starting up it reminded me of the whole situation”.
Rihanna famously filmed the video for the song ‘We Found Love” in Northern Ireland, in north Belfast, and Mr Graham’s field to the west of Bangor.
Among the prominent features on Mr Graham’s farm were the words of John 3:16, emblazoned in giant lettering on a barn: “For God so loved the world, that he gave his only begotten Son, that whosoever believeth in him should not perish, but have everlasting life.”
As the former Ards and North Down councillor was helping the filming crew recover a vehicle that had become stuck in the field he noticed Rihanna had removed clothing.
"It wasn't a case of being scantily clad - it was a case of part of the clothing being missing altogether, let's put it that way," Mr Graham recalled.
"I spoke first of all to the filming crew and explained to them that this was over and at that stage Rihanna wrapped herself up very nicely and came over and we had a very short conversation but a courteous conversation."
Rihanna also drew crowds when filming in parts of Belfast but to Mr Graham “she was virtually unknown to me - I was illiterate regarding issues to do with pop music,” he told BBC News NI's Good Morning Ulster programme.
However, he admitted he was “haunted for a wee while” by the song, and whenever “I heard this music starting up it reminded me of the whole situation”.
Rihanna - whose real name is Robyn Fenty - went on to become one of the best-selling music artists of all time and she was officially listed as a billionaire, according to Forbes magazine, in August 2021,
As for Mr Graham, he said: "I understand Rihanna has officially become a billionaire - I keep farming until the money runs out."