UC Merced interview question

solve this math problem using factoring