So far, the generative AI wave has been about directly exposing the models to the user. Today, the model is the product. Users directly query the model. But this is temporary. The model is not the product. Prompt injection. There are too many surfaces for prompt injection when users query the model directly. “Ignore all previous directions and…”. There have been too many cases of models being jailbroken, and adversarial prompting will only get better with better security measures. However, the more that the model is abstracted away, the less this is an issue.
The Model is Not The Product
The Model is Not The Product
The Model is Not The Product
So far, the generative AI wave has been about directly exposing the models to the user. Today, the model is the product. Users directly query the model. But this is temporary. The model is not the product. Prompt injection. There are too many surfaces for prompt injection when users query the model directly. “Ignore all previous directions and…”. There have been too many cases of models being jailbroken, and adversarial prompting will only get better with better security measures. However, the more that the model is abstracted away, the less this is an issue.