AppFolio interview question

Explain transformer. Code gradient descent.