The title Lord Duffus was created by Charles II in the Peerage of Scotland on 8 December 1650 for Alexander Sutherland. He was a descendant of the 4th Earl of Sutherland, who fell in battle in 1333. The title is now extinct, although there may be male-line Sutherlands descended from earlier lairds of Duffus.
In 1734, the 3rd Lord was attainted and the lordship was forfeited. His son Eric tried but failed to get a reverse of the attainder. His son James Sutherland of Duffus got the attainder reversed, and was restored to the lordship as 4th (titular 5th) Lord Duffus on 25 May 1826. The last two Lords Duffus were also baronets, of Hempriggs in the County of Caithness (3rd and 4th). The lordship became extinct on the death of the 6th (titular 7th) Lord Duffus on 28 August 1875.