interefence between rooms #14
Labels
No labels
bug
dependencies
documentation
duplicate
enhancement
good first issue
help wanted
invalid
question
waiting-reply
wontfix
No project
No assignees
1 participant
Notifications
Due date
No due date set.
Dependencies
No dependencies set.
Reference: bobmaster/matrix_chatgpt_bot#14
Loading…
Reference in a new issue
No description provided.
Delete branch "%!s()"
Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?
Hi there,
I found if I have two or more rooms chatting with say Bing Chat, there are some interefence between them. It seems the bot considers it's talking to the same person. This could be a privacy issue, if two people chatting with the bot and one guy can even guess what questions the other guy asked. Is there possible to isolate rooms? Cheers.
It's possible but at the moment, the simplest way is deploy several matrix_chatgpt_bots, node-chatgpt-api instances and limit bot only working on specific room by setting
room_id
configuration.In this case, I assume we need different tokens for different instances? Like different Microsoft account for different instances?
How much computer resources will each instance require?
Thanks
No need to use different tokens, just one token is enough.
You can use
docker stats
to measure compute resource occupation.Here is a sample compose file
If you use env file
Add
ROOM_ID
to env1,env2,env3If you use config.json
Add
room_id
to config1.json, config2.json, config3.jsonOne more suggestion, use a non-existed room_id at first time launch to let the bot sync and store message in db, then stop it and correct the room_id to let the bot work as usual so as not to mess up room chatting timeline.
sounds reasonable. Thank you.
https://github.com/matrixgpt/matrix-chatgpt-bot this works across different rooms, is there any solution to make your implementation work in a similar way where only one bot is created and different rooms can access it independently without cross talk
I have to refactor the codes to archieve it, so at this time the simplest way is to launch serveral bot instances.
sure got it. amazing implementation, but to use within an application im working on, would be useful if there is one chatbot username that works across rooms. so ill stay tuned for any update. for now im thinking of using https://github.com/matrixgpt/matrix-chatgpt-bot for the chat management and replace the reverse proxy url with different models, as shown in this implementation, which works like a drop in replacement fro openai url: https://github.com/go-skynet/LocalAI
When you launch serveral bot instances, you can use the same username.
The only difference among the instances is
room_id
in config file.oh interesting! thanks will do that
@jaodei @seshubonam
With pandora: https://github.com/pengzhile/pandora/blob/master/doc/wiki_en.md
I can integrated chatGPT web with session isolation like what i did for https://github.com/hibobmaster/mattermost_bot
Maybe there will be three new commands:
!talk
,!goon
,!new
awesome!
with flowise i think that problem is solved automatically as flowise responses have sessions taken care. should run and see. waiting to host the flowise on my url. once done, ill update that
c72e6d6f8e
so, if I add "flowise_api_url": "http://localhost:3000/api/v1/prediction/6deb3c89-45bf-4ac4-a0b0-b2d5ef249d21" in the config file, I can avoid the intereference between rooms?
How can I obtian an id like 6deb3c89-45bf-4ac4-a0b0-b2d5ef249d21 here and the flowise_api_key? I need both of them?
thanks.
No, you still need launch several instances. The only one that avoid the intereference between rooms is ChatGPT WEB used by
!talk
!goon
!new
commands.flowise_api_key
is optional.6deb3c89-45bf-4ac4-a0b0-b2d5ef249d21
There is a code button in the upper right area. You can click it and it will tell you.just on a side note, could adding new instances be automated. like, when user clicks create room button, a new config file or .env content is added
that work without having to restart any docker/cloud instances right
can i add a replit bounty to fix this, if you dont mind. would like to use it to beta test a chatbot im building. dm me on twitter please, id like some continued support, as your work is greaaaat https://twitter.com/seshubon
This solution is ugly, i will try to refactor codes to archive session isolation for all chat commands.
😅😂 sure thanks
Thanking you for the contributions on your repo is an understatement. you
are a champion!
On Wed, May 31, 2023, 1:10 PM BobMaster @.***> wrote: