Commit Graph

166 Commits

Author SHA1 Message Date
trducng
f1330ced26 fix: add final answer check 2024-11-07 03:44:15 +00:00
trducng
d93a24541f fix: register events 2024-10-30 01:18:08 +00:00
trducng
b5227d0b45 feat: update memory UI 2024-10-29 04:38:54 +00:00
trducng
07f8152033 fix: add user_id to KNet retriever 2024-10-21 02:16:22 +00:00
trducng
2995311662 fix: update pipeline description 2024-10-18 08:04:52 +00:00
trducng
d1b0b1e831 feat: add RAG setting panel 2024-10-18 04:58:37 +00:00
trducng
1aaa75e5c1 fix: update knet feedback 2024-10-08 09:16:45 +00:00
trducng
351ec7fd16 feat: add knet feedback 2024-10-08 07:52:32 +00:00
trducng
485c6a5510 fix: page number in knet 2024-10-02 06:16:20 +00:00
trducng
6ac627cc29 fix: retriever setting graphrag 2024-08-18 14:23:45 +00:00
Tadashi
23fa4fb76b fix: update info panel return for graphrag 2024-08-18 20:32:10 +07:00
Tuan Anh Nguyen Dang (Tadashi_Cin)
e50da52a30 feat: add knowledge network index (#118)
* feat: add Knowledge Network index

* fix: update reader mode setting for knet

* fix: update init knet

* fix: update collection name to index pipeline

* fix: missing req

---------

Co-authored-by: jeff52415 <jeff.yang@cinnamon.is>
2024-08-18 19:06:38 +07:00
Tuan Anh Nguyen Dang (Tadashi_Cin)
3ae0fceee4 feat: graph rag (#116)
* fix: reload server when add/delete index

* fix: rework indexing pipeline to be able to disable vectorstore and splitter if needed

* feat: add graphRAG index with plot view

* fix: update requirement for graphRAG and lighten unnecessary packages
2024-08-18 15:16:52 +07:00
Tuan Anh Nguyen Dang (Tadashi_Cin)
8ecac2c04e feat: pdf viewer (#110)
* feat: update pdfviewer

* feat: update missing files

* fix: update rendering logic of infor panel

* fix: improve thumbnail retrieval logic

* fix: update PDF evidence rendering logic

* fix: remove pdfjs built dist

* fix: reduce thumbnail evidence count

* chore: update gitignore

* fix: add js event on chat msg select

* fix: update css for viewer

* fix: add env var for PDFJS prebuilt

* fix: move language setting to reasoning utils

---------

Co-authored-by: phv2312 <kat87yb@gmail.com>
Co-authored-by: trducng <trungduc1992@gmail.com>
2024-08-18 11:22:12 +07:00
trducng
c6101711e1 fix: add conv name suggestion in regen 2024-08-08 03:45:20 +00:00
trducng
f36def867b feat: citation in thread 2024-08-06 10:04:57 +00:00
trducng
389c973048 fix: minor UI change 2024-08-06 09:28:16 +00:00
trducng
0303e1ed3b feat: add conv name suggestion 2024-08-06 09:25:32 +00:00
trducng
ab305b50bb feat: add quick indexing pipeline and update UI 2024-08-06 09:23:40 +00:00
trducng
c414db1951 fix: PDF thumb loader page number logic 2024-08-06 09:00:14 +00:00
trducng
5a00fc13e9 fix: UI text update 2024-08-06 08:58:11 +00:00
trducng
6d354b8996 feat: add thumbnail handling logic in indexing 2024-08-05 13:46:20 +00:00
trducng
591eb2a051 feat: add thumbnail PDF reader for quick multimodal QA 2024-08-05 13:39:32 +00:00
trducng
61ed484154 fix: elastic search with empty doc_ids 2024-08-05 13:37:37 +00:00
taprosoft
214a268b7f fix: clean conversation & file selection UI 2024-07-31 06:53:34 +00:00
trducng
9b1a0c08f7 fix: add exception handling for additional table retriever 2024-07-31 06:16:06 +00:00
trducng
91fc5eb8d9 fix: create embedding for long image chunks 2024-07-30 08:41:35 +00:00
taprosoft
d8fc296d68 fix: update default prompt when no retrieval is used 2024-07-30 08:21:06 +00:00
trducng
f20371e90d fix: allow exponential backoff for failed OCR call (#109) 2024-07-29 15:17:59 +07:00
kan_cin
f23a510e37 feat: add share converstation feature and enable retrieval history (#108)
* feat: add share converstation feature and enable retrieval history

* fix: update share conversation UI

---------

Co-authored-by: taprosoft <tadashi@cinnamon.is>
2024-07-29 15:17:19 +07:00
taprosoft
527b98bd46 fix: default chunk length in simple QA 2024-07-24 07:33:39 +00:00
taprosoft
4c277d8a85 fix: update some default settings 2024-07-17 15:47:37 +00:00
phv2312
79b8511cb0 refactor: codespell 2024-07-17 17:20:40 +07:00
phv2312
774e359dfc fix: update import download_loader 2024-07-17 17:11:17 +07:00
trducng
9e215c406b fix: add openai embedidng exponential back-off 2024-07-16 08:36:17 +00:00
kan_cin
88d02c3770 feat: optimize vector store query db (#105)
* feat: optimize vector store query db

* feat: add file_id to chroma metadatas

* feat: remove unnecessary logs and update migrate script

* feat: iterate through file index

* fix: remove unused code

---------

Co-authored-by: taprosoft <tadashi@cinnamon.is>
2024-07-12 11:11:41 +07:00
taprosoft
7a1bdeb523 fix: escape text in download UI 2024-07-10 04:30:54 +00:00
kan_cin
7e2572865c feat: update docx loader for handle merged table cells + handle zip file upload (#104)
* feat: update docx loader for handle merged table cells

* feat: handle zip file

* refactor: pre-commit
2024-07-10 11:23:44 +07:00
trducng
775476c6ee fix: hotfix image citation 2024-07-09 08:27:08 +00:00
trducng
af2a542a20 fix: minor update logics 2024-07-09 07:04:38 +00:00
taprosoft
e98b797f3b fix: LLM scoring enabled by default 2024-07-08 14:47:28 +00:00
taprosoft
87f14a3924 feat: add warning message for low confidence 2024-07-08 12:02:11 +00:00
taprosoft
813f871df4 fix: less verbose debug log 2024-07-08 11:26:31 +00:00
Tuan Anh Nguyen Dang (Tadashi_Cin)
f0a7576375 fix: improve agent logics (#103)
* fix: improve agent progres display

* fix: update retrieval logic

* fix: UI display
2024-07-08 18:23:50 +07:00
taprosoft
16a7e4fe0a feat: improve UI default settings and add quick switch option for pipeline 2024-07-08 10:44:52 +00:00
Tuan Anh Nguyen Dang (Tadashi_Cin)
b4cee6fcb8 fix: improve retrieval pipeline and relevant score display (#102)
* fix: improve retrieval pipeline by extending first round top_k with multiplier

* fix: minor fix
2024-07-08 15:53:38 +07:00
kan_cin
fccb8f6a74 fix: add encoding utf-8 when save temporal markdown in vectorIndex (#101) 2024-07-08 14:00:07 +07:00
cin-ace
fd54bbd896 feat: add question decomposition & few-shot rewrite pipeline (#89)
* Create few-shot query-rewriting. Run and display the result in info_panel

* Fix style check

* Put the functions to separate modules

* Add zero-shot question decomposition

* Fix fewshot rewriting

* Add default few-shot examples

* Fix decompose question

* Fix importing rewriting pipelines

* fix: update decompose logic in fullQA pipeline

---------

Co-authored-by: taprosoft <tadashi@cinnamon.is>
2024-07-08 11:58:00 +07:00
cin-ace
9e2fe4afc9 fix: update trulens LLM ranking score for retrieval confidence, improve citation (#98)
* Round when displaying not by default

* Add LLMTrulens reranking model

* Use llmtrulensscoring in pipeline

* fix: update UI display for trulen score

---------

Co-authored-by: taprosoft <tadashi@cinnamon.is>
2024-07-07 21:59:59 +07:00
trducng
d04dc2f75d fix: Allow empty string when calling embedding 2024-07-04 12:25:05 +07:00