Hi! I’m a software developer working on a suite of collaborative self-hostable apps to replace proprietary services I couldn’t find a good replacement for.
I am writing this post to seek opinions and ideas now that I am still in the early prototyping phase, before it’s too late to change track.
My idea is to develop a collection of simple single-purpose apps that do one and only one thing. The first app will be called Simple Notes (mirror), a replacement for Google Keep. Every operation is encrypted locally on the client, and the server never sees plaintext data. I am investigating federations models to let users connect to other instances and work collaboratively, much like Lemmy.
So, my goals in order of priority are:
- No compromises on privacy and security
- Completely FOSS
- Real-time collaboration between users
- Asynchronous collaboration (work offline, sync when back online)
- One account to operate on all apps in this suite
- Web UI / desktop UI / mobile UI
- Minimal interface which my grandma can use, no feature-bloat
- No anti-features such as advertisements, tracking, etc…
- Self-hosting
- Federation
After Simple Notes, I plan to keep developing other simple apps, some ideas on my list:
- Simple Notes - Replacement for Google Keep
- Simple Split - Replacement for SplitWise
- Simple Chat - Replacement for WhatsApp/Slack/Meet/Teams
- Simple Docs - Replacement for Google Docs
- Simple Draw - Collaborative drawing app
- Simple Calendar - Replacement for Google Calendar
- Simple Contacts - Replacement for Google Contacts (suggested by @Churbleyimyam@lemm.ee)
Initially I started writing my own protocol (mirror), operating quite differently from Lemmy’s, but then I realized that someone else already has developed a protocol for this purpose: Matrix. It is (optionally) E2EE, it’s FOSS, and it’s federated. So yeah, it sounds like the perfect choice to me. Also, if I pick Matrix, Simple Chat will just be a reskin of Element, so development cost is almost zero.
So, a questions for the developers on the Lemmy Selfhosted community: do you think piggybacking the Matrix protocol would be a good choice? Do you know any alternative that might be more suited for this purpose?
And a question for all Lemmy Selfhosted users: is there a simple app that you would like me to add to the list?
Bonus question: do you know of any Lemmy community where I could repost?
Thank you very much for the time you spent reading my post!
–
Link to source code on my server and GitHub mirror.
–
EDIT: I might have been a bit unclear on my objective. My intention is not to just build a replacement for Google Keep, that’s just the first step of the idea I had. My objective is to build a template from which it should be possible to build all sorts of apps to collaboratively work on documents of various types. Simple Notes (Google Keep) would be for text documents, Simple Split (SplitWise) for expenses (because a list of expenses is a document after all), Simple Chat (WhatsApp) for chats (oh yes, I would say that a list of messages is also just a document), Simple Docs (Google Docs) for… well… text documents, Simple Draw for canvas documents, and finally Simple Calendar (Google Calendar) for a calendar (which, why not, is also document!).
So yeah, I don’t want to just find/build an alternative for Google Keep, I want to find/build a tool to build all sort of simple collaborative apps on top of.
What I am looking for is not the recommendation of an app to simply replace Google Keep, I am looking for a template or even just a protocol on top of which it’s possible to build collaborative document-editing apps.
Simple Notes - Replacement for Google Keep
Yes please!
My use case is a shopping list for my SO and I. I want to be able to add stuff throughout the day, and cross them off once I grab them from the shelf, and separately be able to clear completed tasks.
Do that and I’ll try selling my SO on it.
Simple Chat - Replacement for WhatsApp/Slack/Meet/Teams
Why not just use one of the other Matrix clients?
Simple Docs - Replacement for Google Docs
This seems overly ambitious. The thing I like about Google Docs is all the rendering features and whatnot, I don’t really use the collaborative editing part. If you really want the collaborative bits, those exist.
do you think piggybacking the Matrix protocol would be a good choice?
No. Matrix is designed for chat, not data, and self-hosting it requires a fair amount of resources.
For something this simple, I don’t think there’s an “out of the box” solution here, nor do I think there needs to be one. The main things you need to handle are:
- state changes - same as a non-collaborative app, but you also need to pick who wins
- users and their locations in a document - can even send unsaved snippets as well
I’d personally just DIY it since it’s really not a ton of logic, no reason to bring a whole protocol into this.
But hey, maybe it’ll work out great. Having more options is generally a good thing.
Regarding your requirement, you might want to take a look at KitchenOwl.
If you prefer freestyle notes/lists, Joplin can share and sync note collections as well.
KitchenOwl
Nice! You sir or madame are a wonderful person. This does far more than we need, but honestly, those features look like something we should use anyway (esp. recipes and meal planning).
The shopping list alone is beautifully done. Glad that I could help 🙂
use case is a shopping list for my SO and I. I want to be able to add stuff throughout the day, and cross them off once I grab them from the shelf, and separately be able to clear completed tasks
Sorry for the late reply. Oh yes, that’s what I like about Google Keep, the collaborative aspect. What do you mean by “separately be able to clear completed tasks”? Do you mean being able to do it from multiple devices which are synchronized in real-time?
[Simple Chat] Why not just use one of the other Matrix clients?
Yes, you have a point… let’s keep Simple Chat for later then. I had this idea of making an app for each of my needs and let them all connect to a single server with a single unified user. Good quality Matrix clients already exists, I guess there is no need to build a custom client for the chat if I end up adopting Matrix as the protocol.
[Simple Docs] This seems overly ambitious.
Let’s say that’s a longer term goal for the future. I might be underestimating the complexity of Google Docs, but if you think about it I would say it’s not much more than a rich-text editor. Basically it’s the same things as text notes, just with a bit more formatting options. I couldn’t say the same thing about Google Sheets and Google Present.
No. Matrix is designed for chat, not data, and self-hosting it requires a fair amount of resources.
Why do you think so? I have tried it and it seems to be as simple as any other server thanks to Docker. I have a script to launch it here (mirror). It seems to use 160MB of memory and about 1% of my CPU when idle. I haven’t done any serious tests though, maybe it wouldn’t scale as well as I think.
I’d personally just DIY it since it’s really not a ton of logic
Well… there must always be a protocol behind it, it can be as simple/specific or as complex/generic as you want, but there must always be an agreement of the format of data exchanged between client and server.
By adopting the Matrix protocol, there wouldn’t be any need to write a custom server, because Matrix servers already exist.
Matrix is designed for chat, not data
What’s the difference between chat and data? A chat is a list of messages. A collaboratively-editable document is a list of changes. As far as I understand, Matrix uses “events” to describe things happening. When a user sends a message, the server emits and event like “add user X’s message Y to your list of received messages”. It shouldn’t be too different than emitting an event “replace text at position X with Y” every time a document changes. They even have ephemeral events for temporary state, such as “the user X is currently typing”. That should be similar to “the user X placed their cursor at position Y”.
Do you think I might be oversimplifying or thinking it wrong?
Hey Hey! What a fantastic idea, I sure hope you can manage!
I was immediately wondering why you wouldn’t hop on projects already out there. For example: I recently ditched google Keep // Trello for Joplin, which i think already ticks alot of your boxes, even Async collab should work (but not realtime, and you’d have to manually resolve conflicts). Maybe adding better collab in Joplin is a more efficient way to spend your time? LibreOffice also has Async collab, since I think about 6 months, so while it might be young, it will grow, and might also benefit from another person putting their time towards it.
Whatever you choose to do, I’ll be super interested to see the results.
As far as I know, Joplin is not really real-time collaborative, nor federated. I was using it a few years ago and I like it, that would be a great suggestion for people not interested in those two things.
why you wouldn’t hop on projects already out there
Ah… that’s… yeah, that would probably make a lot of sense. I think that to us developers it’s much easier to come up with our own ideas than to hop onto other projects unless they align very well with our vision. It’s quite unusual to find other people with our very same goals. I’ll be honest, I code for fun. I would like to build this tool because want it more than because I need it, as there already are both Google Keep and Joplin after all. If there was an alternative out there with most of the feature features I need, in a programming language and framework that I am familiar with, I would probably have joined or forked it. But no, unfortunately that’s not the case. My goal is not to just find/build a replacement for Google Keep, my goal is to find/build a framework that can be used to build more collaborative apps in the future. A replacement for SplitWise is my next goal immediately after Google Keep, and I assume (hopefully not too naïvely) that once I will have a starting point, making more similar apps will be virtually free in terms of time required.
Actually, I was just so incredibly lucky that the Matrix protocol seems to overlap almost exactly with all the things I had in mind. I had included a few more features in my draft for a custom protocol, but honestly adopting something already made would save many tens of hours of work, so joining something already existing sounds like a good idea. I don’t think I will be able to contribute code to it though, as it’s developed in a language I am not familiar with (yet), so if I decided to go for Matrix after all, I will just be joining as a consumer.
LibreOffice also has Async collab […] might also benefit from another person putting their time towards it
Oh, that’s actually good to know, thanks! Personally, at the moment I use Google Docs when I need to work in real-time on a document with someone else. In my opinion it’s just too convenient to just be able to share a link which can be opened with a web browser from any device and operating system. There are some good self-hostable web options for documents imho though, which are probably less resource-demanding than LibreOffice.
Unfortunately I am not interesting in contributing to LibreOffice. I have installed it on all of my devices, but I almost never use it.
Whatever you choose to do, I’ll be super interested to see the results.
I’ll take that as an encouragement! Thanks!
I think I understand your requirements more clearly now, a framework for FOSS collaborative work would be really great. I Hope you can find a way to use Matrix for it. Thanks for the explanation.
Man, I loved the google docs realtime collab functionality, they pretty much nailed it day 1 in my eyes. It’s so easy. If your project works/takes off it should be a lot more straightforward for FOSS projects to incorporate it. Hype!
There are several decent note apps that strive to replace Google Keep, but they all seem to fall short on the one feature that keeps me on Keep: Reminders. Being able to jot a note and have it pop up later today, on the weekend, or on an arbitrary recurring schedule is the primary use-case for me. Joplin’s come the closest but the reminders were unreliable, and an unreliable reminder is a useless reminder.
There’s also something to be said for the number of clicks/menus/presses it takes to create a note. If it’s meant to be just a quick note when something pops into your head then it’s nice if it doesn’t take more than a click or two to get it down.
One last thing. A feature that I think would greatly enhance adoption would be an option to import existing Keep notes from a Google Takeout into your Simple Notes.
I have to admit that I didn’t really think about reminders. That would perhaps make more sense for Simple Calendar, perhaps in the future I might consider linking notes and reminders. Or maybe it would make sense to implement it directly in Simple Notes? I don’t know, I’ll keep that in mind for later, thanks!
the number of clicks/menus/presses it takes to create a note
I strongly agree on that. It must be at most as many clicks as on Google Keep, i.e. two clicks (plus a few to open the app).
import existing Keep notes from a Google Takeout into your Simple Notes
I didn’t think about that. That shouldn’t be too hard. After the MVP (minimum viable product) will be ready, imports from various common formats should be implemented, and I guess Google Takeout for Google Keep should be supported too.
Thanks for the suggestions!
Why not use Joplin? Open-source, very flexible, I run it on a bunch of devices and sync it via a EU cloud provider over S3 in an encrypted bucket…
Joplin is not really real-time collaborative, nor federated. Or rather, it wasn’t last time I used it a few years ago, unless things have changed now. As a developer, I like Joplin though, that would be a great suggestion.
Its not really a keep replacement. Its a good note taking app though.
There is a foss alternative to split wise.
There’s also IHateMoney as a self hosted service and MoneyBuster as an Android app to interact with IHateMoney.
Nextcloud Notes or Joplin (nevermind all the other features Nextcloud provides) tick most of your boxes. They’re more productivity focused than privacy focused, it doesn’t do “zero knowledge” encryption the way you’re describing, but I don’t really understand the point of that when you’re self-hosting and the server host belongs to you anyway. The federation may leave you wanting more and the collaboration might not be “real time” enough for you either, though. If you can build something better by all means go for it.
Oh yeah, both Joplin and NextCloud are great. I tried them both in the past. NextCloud is a bit bloated in my opinion though, I was hoping to go for something simpler both to install and to use.
Most of us here on the Lemmy Selfhosted community are skilled enough to keep a computer running somewhere, expose it securely on the internet (or just LAN, if that’s good enough), and install their own services such as Joplin and NextCloud, but my goal would be to make something that you don’t need to self-host. If you can trust any server, you don’t need to host your own. I like the idea of building a network comprised of both self-hosting users, and “normal” users, like here on Lemmy.
The federation may leave you wanting more and the collaboration might not be “real time” enough for you either, though. If you can build something better by all means go for it.
I’m not sure I understand what you mean. Do you mean writing a protocol that supports federation is a very difficult thing to do? Actually my first draft didn’t include federation as that’s just too much for my skills. But I am considering adopting Matrix, and Matrix includes federation, so why not? They built real-time messaging with Matrix, so I would assume that should be real-time enough for document editing.
IMO, the more self hostable options we have for services, the better. This sounds like a good idea to me.
Good luck with your project and thank you for taking the time to contribute to the free and open source community.
I’ve specifically been looking for a self-hostable keep alternative for a while now. This sounds amazing, will be following the project!
same here
This sounds great. I would definitely love a splitwise alternative in particular!
You may want to think about using another name for your app suite though. Since it may bring confusion with the simple mobile tools (https://simplemobiletools.com/index.html) which for example also have a “Simple Notes” app.
Simple Mobile Tools were forked to https://www.fossify.org/
Ah, that’s why the UI looked familiar! I have some of their apps on my Android :P
Ah, that’s a shame, I quite liked the idea of using the “Simple” prefix. Well, naming software is hard! I’ll just keep it as a temporary name for now. Thanks!
Naming software is one of the hardest problems in all of software development.
There are 2 hard problems in computer science: cache invalidation, naming things, and off-by-1 errors.
– Leon Bambrick
Just take a common word and remove a vowel or too. That’s still hip, right?
Power Operations -> Po Op -> Poop
Perfect.
“Everybody PoOps. Why not with us?”
Simpel. Simpal. Simpol. Etc… :)
It’s fossify now. Check them out! Original was sold afaik! So steer clear
“Simply”?
Oh, I like this a lot! I will consider adopting it if I will actually get this project started. Thanks!
Except for federation, you described Notesnook, although it’s a bit hard to self host because the server parts are in alpha with few documentation. I wanted to try it but it looked too complex (hard to backup and hard to maintain) with all those server components, mongodb in a replica set and S3
For self hosting, why e2ee? It makes backups much more complicated than having plain text/images on the server. Consider making it optional 😊
There’s already an international open source and federated standard for Journals, Tasks and Notes. It’s called iCalendar-standard (RFC-5545) . See the VToDo component, relevant for your Google Keep alternative.
Also check out JTX Board
Pros:
- FOSS
- Federated
- List, Grid, Kanban views
- Reminders
- Alarms
- Location
- More
Cons:
- Markdown only, no WYSIWYG.
Syncing:
- WebDav server (many FOSS and selfhostable servers available). For mobile client there’s DavX.
- WebDav Encrypted sync server Etesync which is FOSS and selfhostable.
These standards and protocols are compatible with almost every software remotely related, including Thunderbird, KDE’s Kontact, and many more. And the feature set matches or even exceeds Google Keep’s capabilities.
My humble opinion is that you don’t need to reinvent the wheel, just build on top of what is already widely used, tested, documented, FOSS, privacy respecting, standards compliant, audited.
Could you maybe work with someone together, or get inspiration from something like the docs project from the european union https://docs.numerique.gouv.fr/ ?
Moreover, I’m an “advanced user” and I want to write with markdown and/or typst. A wysiwyg typst editor would be amazing
Edit: did I mix google keep and docs? Probably. Sorry 😅
Edit2: are you looking into vjournals? https://connect.mozilla.org/t5/ideas/support-vjournal-in-thunderbird/idi-p/46295
Oh yeah, I looked into and tried some of the European collaborative docs softwares, in particular I like this Numerique’s clean Material UI interface and I’m definitely going to take inspiration from it (although I haven’t installed and tried it, I just checked screenshots). Although, if you are recommending it as an alternative to my idea, Numerique doesn’t seem to be federated, nor to be privacy-centric (well… it is if you self-host, but my idea is to let people collaborate through different servers, like Lemmy, I don’t want users to need to trust the owner of the servers they join). And I really need an alternative to Google Keep more than Google Docs. I’ll be honest, Google Keep is really well made in my opinion, I would say we don’t yet have a good self-hostable alternative.
did I mix google keep and docs
Yeah, Google Keep is more like for text snippets, links, checklists, scribbles, and images. Google Docs is a full-fledged RTF editor. I was planning to implement the two things separately. I considered implementing Markdown in the Google Keep replacement, but I am still undecided whether it might count as feature-bloat.
vjournals
Oooh, that’s nice. I know about VCard and VCal, but I didn’t know about VJournal. Thanks for the hint, this might be very useful!
CRDTs are good for both realtime collab and local-first.
I didn’t know this term! I knew about DAGs which are probably a way to implement CRDTs. I just read the definition on Wikipedia, it says that “[CRDTs feature] an algorithm (itself part of the data type) automatically resolv[ing] any inconsistencies that might occur [in case of conflicts]”, that sounds interesting. I was thinking to try to resolve conflicts automatically whenever possible by adapting Git merge strategies, and when impossible: either just concatenate both versions and let the users fix it manually, or giving users the option to choose line-by-line which version they want.
With this keyword I might be able to find more literature on the topic. Thank you for suggesting it!
Disclaimer, I am idiot with no time.
I know Joplin exists but I havent got around to setting it up.
Would you look a developing a shared notes app, Wanderlist used to be great before microsoft for Shopping lists.
Sounds nice. I would use it. Keep is one of the last Google services I still use.