I mean, be careful. These llms can be honeypots for data. Like, if you’re using it for cover letters, or work, you’re sending tons of personal info to random websites.
I would recommend sticking to actual, reputable vendors for llms, or running your own. I have a GTX 1070 and can run some pretty decent models these days locally using koboldai.
Bing is probably the only way to use gpt 4 without paying for it, and Microsoft probably won’t steal your bank account info.
I believe Librechat would achieve your goals, but you’d need a PC or server to host it in. It supports all major API.
Kobold light might with as well, and doesn’t need to be hosted locally, but I don’t think it supports Claude haiku specifically, for unknown reasons.
Additionally, the official Claude api workshop is pretty good on desktop, but it only supports Claude.