Martian is solving the largest problem in AI: making AI safe by letting us look inside the brains of models like GPT-4. This also lets us make models more effective and less expensive. All of modern AI exists because of the Transformer architecture. Nobody knew it at the time, but the invention of the Transformer solved a fundamental problem: previously, we couldn't put enough data through our models to get them to understand language. The result was GPT-3, ChatGPT, GPT-4, and a host of other models; models which actually work and understand natural language. Now that we have working AI, a different set of problems arises. How do we know what our models are doing, and how do we know that they will actually do what we want? From this perspective, the Transformer is a nightmare. It's a black box where you can see the inputs and outputs, but have no understanding of what's going on inside.
Something looks off?On-site & Remote