Kevin McCarthy bid farewell to Congress on Friday with a sparsely attended address on the House floor, marking an end to 15 years in Congress bookended by his unprecedented ouster from the speakership and his resignation midway through his term.

His tenure culminated in him becoming the most powerful Republican lawmaker...