Commit Graph

227 Commits

Author SHA1 Message Date
Hakan Shehu
1fd2cb0245 Update packages (#94) 2025-06-25 19:58:24 +02:00
Ylber Gashi
af44d9bc16 Add Helm charts for Kubernetes self-hosting (#87)
* Add Helm chart for Kubernetes deployment and reorganize hosting setup

- Created Helm chart for deploying Colanode on Kubernetes with PostgreSQL, Redis, and MinIO configurations
- Moved Docker Compose files to /hosting folder for better organization
- Added health check endpoints for database, Redis, and S3 services
- Introduced Dockerfile for PostgreSQL with pgvector extension to support Helm deployment
- Added GitHub Actions workflow for building and publishing Helm chart
- Updated README with Kubernetes deployment instructions

* Renames and restructure

* Update Helm chart workflow for Colanode deployment

* Remove health check route and related configurations from the server and Kubernetes deployment files.

---------

Co-authored-by: Hakan Shehu <hakanshehu15@gmail.com>
2025-06-25 19:06:35 +02:00
Hakan Shehu
035ed6b677 Add background jobs to merge document & node updates (#90) 2025-06-25 07:13:28 +02:00
Hakan Shehu
b3590a70ed Implement pre-aggregated counters for users, nodes and upload storage used (#82) 2025-06-23 21:45:52 +02:00
Hakan Shehu
9294600c61 Update packages (#66) 2025-06-15 11:55:43 +02:00
Hakan Shehu
b711af0431 Add force path style config for s3 - fixes #62 (#65) 2025-06-15 11:39:35 +02:00
Hakan Shehu
e0db60fdef Change default cors origin to localhost:4000 (#59) 2025-06-12 23:59:29 +02:00
Hakan Shehu
756af021d1 Implement login with google (#57) 2025-06-12 22:08:54 +02:00
Hakan Shehu
30bdd2dce2 Minor fixes for server config url generation and file preview (#50) 2025-06-11 21:47:06 +02:00
Hakan Shehu
29d7fcdb0d Prepare for release 0.2.0 (#49) 2025-06-11 20:07:12 +02:00
Hakan Shehu
9e6d53d147 Allow users to delete custom servers (#48) 2025-06-11 16:13:48 +02:00
Hakan Shehu
08ffd69229 Update mutation naming convention (#47) 2025-06-11 12:55:15 +02:00
Hakan Shehu
eb3a8a9216 Docker and workflow improvements (#46) 2025-06-11 12:31:52 +02:00
Hakan Shehu
30e15e4bd3 Web version (#43)
* Create client package
* Create the UI package
* Init web app
* Use isomorphic 'ws' for web sockets
* File and asset implementations
* Use Opfs SAH version of sqlite in browser
* Generate Svg sprites for emojis and icons
* Include emojis sprite
* Improve and refactor assets
* More assets improvements
* Implement emoji and icons db import as readonly
* Improve import paths
* Handle concurrency limits for sqlite
* Fix event broadcast in web
* Pass windowId for subscribe and unsubscribe queries in desktop
* Remove asset context
* Implement avatar upload/download with the new structure
* Improve file handlings
* Move the necessary dependencies to client and ui packages
* Update packages
* Improve open file dialog
* Make sure database files are deleted in browser
* Improve avatar loading
* Improve file loading
* Fix some assets
* Implement asset caching for offline access
* Small fixes and improvements
* Use server instead of pre signed urls for file upload/download
* Cleanup some client related metadata
* Switch Axios with ky
* Refactor mutation results
* Minor concurrency fix
* Refactor web sockets
* Improve file uploading
* Handle connection close on server
* Use stream for downloading the file
* Add config options for cors
* Update document in all tabs on local change
* Include necessary icons for web
* Update docker compose
* Implement server upgrade required component
* Use correct client type and platform in web and desktop
* Improve service worker
* Improve versioning
* Fix an import
* Minor fixes
* Update some user endpoints
* Minor endpoint changes
* Enable app badge for desktop
* Add error handling in some database operations
* Update mutation naming convention
* Update query naming convention
* Update event and some metadata naming conventions
* Update event and job naming conventions in server
* Update Github workflow files
* Restructure assets directory
* Update packages
* Upgrade to Zod v4
* Upgrade to react 19
* Upgrade to tailwind v4
* Minor ui improvements
* Fix some cursor pointers
* Add browser not supported message in web
* Enhance server create flow, allow insecure connections and custom api paths
* Execute electron-rebuild as postinstall command
* Update docker compose
2025-06-11 00:14:17 +02:00
Ylber Gashi
87e30a512c Improve config parsing (#37) 2025-05-07 20:41:17 +02:00
Ylber Gashi
47e5bed3a4 Fix JSON parsing in build info retrieval in server configuration (#36) 2025-05-07 19:59:45 +02:00
Ylber Gashi
147c4230d9 Enhance GitHub Actions workflow for server app deployment (#35)
- Added a step to set up QEMU for multi-platform builds
- Specified target platforms for Docker build: linux/amd64 and linux/arm64.
- Corrected the COPY command in Dockerfile to use relative paths correctly.
2025-05-07 18:44:44 +02:00
Hakan Shehu
f22e6d43bf Use zod for config parsing and some folder restructure (#29) 2025-05-04 11:31:41 +02:00
Ylber Gashi
14bcb55ea0 Updated docker-compose configuration: (#28)
- changed PostgreSQL and Redis passwords
- replaced Redis service with Valkey
- added Mailpit for local SMTP testing, and update MinIO image version

Updated email service to remove SMTP user and password checks.
2025-05-04 10:45:55 +02:00
Hakan Shehu
4998a9d4b2 Refactor and improve node cleanups on delete (#24) 2025-05-02 10:32:38 +02:00
Hakan Shehu
b6c21ac3db Update packages (#23) 2025-05-01 23:19:31 +02:00
Hakan Shehu
00b91c3e3c Implement workspace delete (#21) 2025-05-01 19:48:47 +02:00
Hakan Shehu
b86ae4e5e4 Implement auth ip rate-limits as fastify plugin (#20) 2025-05-01 11:30:12 +02:00
Hakan Shehu
90c7a22685 Send client metadata as headers on each request (#19) 2025-05-01 10:57:24 +02:00
Hakan Shehu
7e5c31d7f8 Include immutable version and commit sha as part of server docker build (#18) 2025-05-01 10:41:10 +02:00
Hakan Shehu
a32058cdab Change server host 2025-04-30 14:24:42 +02:00
Hakan Shehu
412a396b28 Switch from express to fastify (#16)
* Switch from express to fastify

* Use zod validation for api routes

* Fix type in password reset routes

* Use string as data type for bigint because of serialization issues

* Fix use of user id instead of account id for some file operations
2025-04-30 11:07:58 +02:00
Hakan Shehu
915f688115 Make SMTP service optional 2025-04-28 19:40:18 +02:00
Hakan Shehu
1d739879c3 Implement mentions 2025-04-28 19:28:58 +02:00
Hakan Shehu
a0df904981 Update packages 2025-04-23 18:04:40 +02:00
Hakan Shehu
63437894bf Implement password reset 2025-04-23 14:33:23 +02:00
Hakan Shehu
0b347db97c Check ai enabled before scheduling embeddings 2025-04-23 10:34:03 +02:00
Hakan Shehu
4ca3785db4 Update server packages 2025-04-08 16:51:53 +02:00
Hakan Shehu
130524708d Update packages 2025-03-17 23:33:48 +01:00
Hakan Shehu
399f20b1e4 Merge pull request #14 from colanode/ai-assistant-rag
Vector embeddings and initial implementation of AI assistant RAG pipeline
2025-03-10 22:18:04 +01:00
Ylber Gashi
0505e1fbe7 Remove automatic assistant response job scheduling on node creation 2025-03-05 20:53:01 +01:00
Hakan Shehu
d095dbbd16 Add recurring jobs to check node and document embeddings 2025-03-03 23:07:50 +01:00
Ylber Gashi
e83b60b513 Simpler chunk summaries and metadata handling at response time
- Extract common AI-related utility functions into a new ai-utils.ts module
- Create a metadata handling library with fetchMetadataForContextItems
- Update chunking and embedding services to use new utility functions
- Improve context retrieval and scoring with recency and hybrid search weights
- Enhance chunk summarization with a more flexible prompt template
- Reorganize types for better type safety and modularity
2025-03-02 17:54:30 +01:00
Hakan Shehu
c4b9aa320a Minor refactoring 2025-02-27 22:30:00 +01:00
Ylber Gashi
c33fc4a024 Add summary column and enhance search vector generation for embeddings 2025-02-22 18:43:56 +01:00
Ylber Gashi
29c96f7dd6 Add support for specifying context nodes in AI assistant response 2025-02-21 22:49:00 +01:00
Ylber Gashi
93c9e26f4f Improve document metadata retrieval and prompt formatting 2025-02-21 16:39:32 +01:00
Ylber Gashi
415922d73f Enhance document metadata with database context and improve enrichment prompts 2025-02-21 16:00:52 +01:00
Ylber Gashi
45d43b1e95 minor refactoring on llm-prompts 2025-02-21 15:47:00 +01:00
Ylber Gashi
6f53f0bc1c Refactor assistant library with improved context and document formatting 2025-02-21 15:43:49 +01:00
Ylber Gashi
0d7a902836 Enhance context retrieval with author information and metadata
- Add author name and ID to document and node retrieval services
- Implement bulk author fetching for more efficient metadata retrieval
- Update search result types to include created by information
- Improve context formatting in assistant response generation
- Modify metadata handling to include more detailed author information
2025-02-21 15:30:29 +01:00
Hakan Shehu
abeda565f0 Reinstall diff package in server because of some problems in production build 2025-02-21 14:45:22 +01:00
Ylber Gashi
320a9a0dcd Merge branch 'main' of https://github.com/colanode/colanode into ai-assistant-rag 2025-02-21 11:54:49 +01:00
Ylber Gashi
00b0c116b5 Add LangGraph, Google GenAI, and Langfuse dependencies 2025-02-21 11:54:03 +01:00
Ylber Gashi
00162ee06e Refactor assistant response job and extract core assistant logic
- Move assistant response chain and related functions to a dedicated `assistant.ts` library
- Simplify `assistant-response.ts` by delegating complex logic to the new library
- Create type definitions for assistant chain state and related types
- Improve modularity and separation of concerns in AI assistant implementation
- Remove deprecated `ChunkingService` and replace with functional `chunkText` approach
2025-02-21 11:52:59 +01:00