Company founder Tony Beltramelli has just published a research paperthat reveals how it has achieved that. It uses cutting-edge machine learning technologies to create a neural network that can generate code automatically when it’s fed with screenshots of a GUI.
The Pix2Code model actually outperforms many human coders because it can create code for three separate platforms, including Android, iOS and “web-based technologies,” whereas many programmers are only able to do so for one platform. Pix2Code can create GUIs from screenshots with an accuracy of 77 percent, but that will improve as the algorithm learns more, the founder said.
Beltramelli has already shared some of the details about his technology on GitHub, and plans to make the full source code for Pix2Code available later this year.
