Now this is how[0] we get some of the most magical Star Trek technology that eludes us to this day, such as sliding doors. Because if you notice, they work much, much better than real-life ones, because they seem to be doing something like this:
if(within 10 meters of door then) {
if(Jev(
[A] Intends to go through the door
[B] Passing by, loiters, or otherwise
[C] Other
) == most definitely A) {
// open doors, +/- identity/security check
} else {
// ignore
}
}
Keywords: ambient awareness, understanding of intent.
Most interactive tech on Star Trek is like this - from phasers to consoles to communicators to voice interactions with the ship's computer. The computer seems to be aware of the user and surrounding, and actively infers intent from context, to DWIM ("do what I mean") and when they mean it, instead of doing dumb things on simple triggers.
--
[0] - The direction, not final implementation - surely we can work out how to do it more efficiently than wrapping around final stage of LLM. But the point is, multimodal.
Nice! I would love to use it for images as well.
Then again is using Grammar-Based Decoding with a json response not the same? Is Jev just that with nice caching?
Because then I have been using that already…
Jev is rumored to be a 30B model, and it's input price is MUCH cheaper than similarly sized models. The maker is also heavily focused on having a profitable product, so it's unlikely to be subsidizing the cost, especially since they say they have more demand than what they can serve.
Most interactive tech on Star Trek is like this - from phasers to consoles to communicators to voice interactions with the ship's computer. The computer seems to be aware of the user and surrounding, and actively infers intent from context, to DWIM ("do what I mean") and when they mean it, instead of doing dumb things on simple triggers.
--
[0] - The direction, not final implementation - surely we can work out how to do it more efficiently than wrapping around final stage of LLM. But the point is, multimodal.
[B] Not a hotdog