Commit Graph

78 Commits

Author SHA1 Message Date
Shams mosowi
7f957cb678 bigquery spark update 2021-06-24 11:51:34 +10:00
Shams mosowi
b9725a559f fix ft-builder false positive 2021-06-23 13:31:03 +10:00
Shams mosowi
b20082aa8e Merge branch 'develop' of https://github.com/FiretableProject/firetable into develop 2021-06-22 22:45:53 +10:00
Shams mosowi
4a22810009 configurable projectID for bigquery 2021-06-22 22:45:21 +10:00
Bobby
e35ee82c91 code editor help info for derivatives and default values 2021-06-22 16:42:56 +10:00
Shams mosowi
409f7fcfab capture loader errors 2021-06-19 12:09:04 +10:00
Bobby
20e34ffbde ft build stream: style update, empty view, icon status 2021-06-18 13:56:20 +10:00
Bobby
7408b140a4 ft build stream: add error messages and fail status 2021-06-18 13:14:00 +10:00
Bobby
433fdaeac5 ft-build stream: individual log timestamp; status 2021-06-17 22:28:19 +10:00
Bobby
baaf859d2d ft build: subcollection for logs 2021-06-17 15:58:13 +10:00
Bobby
af58f53b29 ft build: add logs to db for each table 2021-06-16 19:55:39 +10:00
Shams mosowi
d3db79dadc mailchimp spark 2021-05-06 21:40:35 +10:00
Bobby
ea2c566aec bigquery spark issue fix 2021-05-06 15:02:34 +10:00
Bobby
eb0995f09d bigquery spark rate limit update 2021-05-03 16:40:23 +10:00
Bobby
1a329e6322 bigquery spark update 2021-05-03 15:39:45 +10:00
Bobby
09d3faa9b8 implement bigquery rate limit retry algorithm 2021-05-03 14:54:13 +10:00
Bobby
ebaa6d73c9 bigquery spark update 2021-05-03 12:07:55 +10:00
Bobby
f9782d3fce biggquery spark: fix new line issue and add unknown type warning 2021-05-03 11:56:57 +10:00
Bobby
5e6ec5cc74 automate bigquery dataset, table and schema creation and update 2021-04-30 21:38:51 +10:00
Bobby
e77ff5ad10 create dataset/table if not exist in bigquery index spark 2021-04-30 17:26:41 +10:00
Bobby
6b2151fd1c update bigquery sql type 2021-04-30 15:11:53 +10:00
Bobby
b26e8e2e60 support more data types for bigquery 2021-04-30 14:58:52 +10:00
Bobby
247c883255 add derivative data type support for bigquery spark 2021-04-30 14:31:23 +10:00
Bobby
7631a19c44 fix bigquery spark update and url issue 2021-04-30 02:36:50 +10:00
Bobby
2dfa1192fd add firetable type support for bigquery spark 2021-04-30 01:46:30 +10:00
Bobby
764a4b513b add field types to sparks 2021-04-29 19:25:49 +10:00
Bobby
78f67bf9ab add big query spark 2021-04-28 18:56:37 +10:00
Bobby
5c212b71cb remove unused safe-eval 2021-04-28 18:30:27 +10:00
Scott Waddell
6e5f7434c9 add forced updated listener to derivatives 2021-04-21 16:34:54 +10:00
Bobby
1efc45a8a4 move utilfns from loader to code editor 2021-04-21 13:25:54 +10:00
Bobby
e6124ec4b3 fix ft-build secret manager not exist issue 2021-04-21 12:43:56 +10:00
Shams
98bea2b5b4 Merge branch 'develop' into rc-add-derivitave-storage 2021-04-21 05:37:55 +10:00
Scott Waddell
0667ea357b fix lint error 2021-04-20 16:57:14 +10:00
Scott Waddell
fb7a84d025 add storage ref to derivative code 2021-04-20 14:44:48 +10:00
Bobby
630cc9e68d ft-builder fix spark traiding ";" issue 2021-04-20 12:50:08 +10:00
Bobby
67bce3b644 ft-builder fix utilFns spark import 2021-04-20 12:32:24 +10:00
Shams mosowi
c37885d938 Merge branch 'develop' of https://github.com/AntlerVC/firetable into develop 2021-04-08 23:26:55 +10:00
Shams mosowi
336adf8032 fix sparks utilFns import 2021-04-08 23:26:46 +10:00
AntlerEngineering
5ef4d2f1bc Merge branch 'develop' into meilisearch 2021-04-08 17:41:08 +10:00
Shams mosowi
d8485a33f2 gcloud set project 2021-04-07 16:05:58 +10:00
Shams mosowi
266ca4c181 sparks utilFns access 2021-04-07 15:38:39 +10:00
Shams mosowi
d949be2aba added sparks labels 2021-04-04 17:35:11 +10:00
Bobby
e942240843 add meili search spark 2021-03-31 21:18:37 +11:00
Bobby
68c913d9b2 wrap require sparks dependency file into error logger 2021-03-31 21:18:33 +11:00
Bobby
7ad04efa48 dockerignore typo fix 2021-03-31 18:00:11 +11:00
Shams mosowi
b12db11e39 fix ft_build terminal 2021-03-31 08:30:10 +10:00
Shams mosowi
17f501d152 task spark defination and compiler fixes 2021-03-30 19:00:18 +10:00
Shams mosowi
79f34637d5 update hasChanged 2021-03-30 15:30:44 +10:00
Shams mosowi
3aa18ef17e Merge branch 'develop' of https://github.com/AntlerVC/firetable into develop 2021-03-30 08:55:34 +10:00
Shams mosowi
53b1d507b6 hasChanged reducer 2021-03-30 08:51:55 +10:00