The most advanced neural network architecture to date. The transformer is a major improvement over the recurrent neural network (RNN). Initially presented in a 2017 paper by eight scientists at Google entitled "Attention Is All You Need," a transformer is able to understand the relationships between words that are far apart in a block of text. Each word (token) is assigned a relevance score that is weighed with every other word. For more details, see
AI Attention.
Will Some New Method Be Better?
Why not? Technology never stands still for too long. However, from the standpoint of global popularity, the AI industry is very new even though it was discussed and debated in the 1950s. A hardware-based neuron was even developed back then (see
SNARC). In the meantime, the transformer method is "transforming" the world.