Does your research able to take most relevant stuff? Let's say i search for flight tickets, is it able to really find the most cheat ones
shken
What's deep research compared to more normal research?
hgomersall
> Never spend more than you budgeted
I assume that this is "$ spent on search + $ spent on LLM" < budget, but how do you handle the LLM spending more than you would expect on a request? Or is this handled by max_tokens and some form of pricing table? (and if so, how does caching play a role?)
daybox
> Honest numbers
I'm glad your numbers are honest! For a moment I thought, hey, maybe this person's numbers are lying to me... but it turned out they were not so thank you!
comments (6)
shken
hgomersall
I assume that this is "$ spent on search + $ spent on LLM" < budget, but how do you handle the LLM spending more than you would expect on a request? Or is this handled by max_tokens and some form of pricing table? (and if so, how does caching play a role?)
daybox
I'm glad your numbers are honest! For a moment I thought, hey, maybe this person's numbers are lying to me... but it turned out they were not so thank you!
hankbond
basedpolymer
recroad