ai measure
This is about the Chatbot Gemini Extension
I'd like to implement a gen-AI feature in my app for general use by the entire organization, but I need a way to monitor and limit how much they use or the cloud cost could spiral out of control. could we have a token count (both prompt and response) in the status map in the transaction document? this way i can keep track of each user's token consumption. with this, it would then be possible to put a reasonable cap on token usage to prevent abuse.
superb extension by the way. thanks!
2
votes
Ahmad Amirul Abdul Manaf -
shared this idea