0 Votes

Changes for page Friday 14 February 2025

Last modified by dennis yoshikawa on 2025/02/14 01:23

From version 6.2
edited by dennis yoshikawa
on 2025/02/14 01:13
Change comment: There is no comment for this version
To version 2.4
edited by Abdurachman Putra
on 2025/02/13 09:43
Change comment: There is no comment for this version

Summary

Details

Page properties
Parent
... ... @@ -1,1 +1,1 @@
1 -Weekly Report.February .WebHome
1 +Main.PT GUE.WebHome
Author
... ... @@ -1,1 +1,1 @@
1 -XWiki.dennis
1 +XWiki.surya
Content
... ... @@ -10,30 +10,10 @@
10 10  What Have You Done?
11 11  {{/success}}
12 12  
13 -* Airflow-airbyte maintenance
13 +1. xxx
14 +1. xxx
15 +1. xxx
14 14  
15 -~1. create task for delete gcs folder table dharmadexa
16 -2. ⁠change incremental method in airbyte for tb)
17 -
18 -
19 -* ⁠*D2D*
20 -
21 -~1. enhance logic stickness rate (mart)
22 -2. ⁠weekly regrup w/product
23 -
24 -* MCN
25 -
26 -~1. troubleshoot on DAG and resource
27 -2. ⁠repointing new database for all pipeline existing
28 -
29 -* Screening
30 -
31 -~1. regroup w/PM and DA for validate data and discuss funneling data
32 -2. enhance logic fact table dharmadexa
33 -3. ⁠preparation dharmadexa data phase 3 (funneling)
34 -4. ⁠testing geo.py to get city from long lat
35 -5. ⁠migrasi dataset cleaned_screening_merck.dim_screening_stunting to CH
36 -
37 37  {{warning}}
38 38  What Issues You Have?
39 39  {{/warning}}
... ... @@ -51,136 +51,91 @@
51 51  1. xxx
52 52  
53 53  **What Support You Need? (Optional)**
54 -
55 -
56 -----
57 -
58 -
59 59  )))
60 60  
61 61  
62 -== (% id="cke_bm_29973S" style="display:none" %) (%%)Data Analyst ==
37 +== Data Engineer ==
63 63  
64 64  >What Have You Done in This Week?
65 65  
66 66  (((
67 -{{success}}
68 68  What Have You Done?
69 -{{/success}}
70 70  
71 -1. **Dharma Dexa Phase 2** – Completed the second phase of Dharma Dexa.
72 -1. **Migration from Looker to Metabase** – Transitioning data visualization and analytics from Looker to Metabase.
73 -1. **Redesigned DKonsul Data** – Improved the structure and organization of DKonsul data.
74 -1. **Ad-hoc Requests** – Handled various on-demand data requests.
44 +1. xxx
45 +1. xxx
46 +1. xxx
75 75  
76 -{{warning}}
77 77  What Issues You Have?
78 -{{/warning}}
79 79  
80 -1. **Metabase Limitations** – Limited chart options and flexibility in customization, particularly a lack of aggregation functions.
50 +1. xxx
51 +1. xxx
52 +1. xxx
81 81  
82 -{{info}}
83 83  What Next You Will Do? (Optional)
84 -{{/info}}
85 85  
86 -1. **Continue Redesigning DKonsul Data**
87 -1*. Refining the data funnel from consultation → prescription → transaction.
88 -1. **Continue Migration to Metabase** – Ensuring a smooth transition from Looker to Metabase.
89 -1. **Dharma Dexa Phase 3** – Proceeding with the next phase of the Dharma Dexa project.
90 -1. **AppSheet MCN Visit Tracker Dashboard** – Developing and optimizing the dashboard.
56 +1. xxx
57 +1. xxx
58 +1. xxx
91 91  
92 -**What Support You Need? (Optional)**
93 -
94 -1. **Data Validation** – Ensuring data accuracy and consistency.
95 -1. **Dharma Dexa Screening Enhancements**
96 -1*. Assigning a **new screening ID** for each event, especially if different questions and inputs are involved.
97 -1*. Adding **location input (province, city)** for better analysis.
60 +What Support You Need? (Optional)
98 98  )))
99 99  
63 +== Data Analyst ==
100 100  
101 -----
102 -
103 -== Data Analyst & AI ==
104 -
105 105  >What Have You Done in This Week?
106 106  
107 107  (((
108 -{{success}}
109 109  What Have You Done?
110 -{{/success}}
111 111  
112 -**AUTOMARK**
70 +1. xxx
71 +1. xxx
72 +1. xxx
113 113  
114 -1. Deploy, evaluate and making documentation of **Screening Dharma Dexa API** to be accessed by Tech team. The API is deployed at [[https:~~/~~/datalake.ptgue.com/v1/users_dd>>https://datalake.ptgue.com/v1/users_dd]] and the **documentation is already sent to Tech team**. **The API could be accessed using prompt** to retrieve user that relevant to the prompt. Per 13 Feb 2024, **the RAG Accuracy is 87,50%**
115 -1. Deploy, evaluate and making documentation of **master user GUE Ecosystem** to be accessed by Tech team. The API is deployed at [[https:~~/~~/datalake.ptgue.com/v1/users>>https://datalake.ptgue.com/v1/users_dd]] and the **documentation is already sent to Tech team**. **The API is already tested by Tech team and have no issues.**
74 +What Issues You Have?
116 116  
117 -**MCN**
76 +1. xxx
77 +1. xxx
78 +1. xxx
118 118  
119 -1. Fixing resource spike issue caused by scraping schedule. The issue is already fixed and pass the test for 3 days (wednesday, thursday, and friday). **Scraping time is decreased from 1 minute per user to the maximum of +-20 seconds per user.** **(Pairing with Syifa-DE)**
120 -1. **Repoint, re-align, and redesign the pipeline and database** that being consumed for scrapping.** (Pairing with Syifa-DE)**
80 +What Next You Will Do? (Optional)
121 121  
122 -**Automation**
82 +1. xxx
83 +1. xxx
84 +1. xxx
123 123  
124 -1. **Implement compliance mapping** with the newest data from compliance team
125 -1. Data, flow, and script validation for user report performance doctor. **The sample report is already validated by dr.Astrid**
86 +What Support You Need? (Optional)
87 +)))
126 126  
127 -**Others**
89 +== Data Analyst & AI ==
128 128  
129 -1. Reqeust + enhance dashboard merck
130 -1. Request dkonsul data for online doctors, transactions, prescriptions, Dexa prescriptions, comparison new users january
131 -1. Request data ICD-10
91 +>What Have You Done in This Week?
132 132  
93 +(((
94 +{{success}}
95 +What Have You Done?
96 +{{/success}}
97 +
98 +1. xxx
99 +1. xxx
100 +1. xxx
101 +
133 133  {{warning}}
134 134  What Issues You Have?
135 135  {{/warning}}
136 136  
137 -1. There is no info regarding database repointing of MCN from tech team. So, the data is not updated. Already solved by coordinating with Product Team
138 -1. Need to enhance the RAG accuracy to around 90%
106 +1. xxx
107 +1. xxx
108 +1. xxx
139 139  
140 140  {{info}}
141 141  What Next You Will Do? (Optional)
142 142  {{/info}}
143 143  
144 -1. Increase RAG accuracy by adding more train query LLM
145 -1. Start daily recurring scraping for tiktok dashboard
146 -1. Start dkonsul insight next week
114 +1. xxx
115 +1. xxx
116 +1. xxx
147 147  
148 148  **What Support You Need? (Optional)**
149 149  
150 -
151 -=== Summary ===
152 -
153 -Berikut ringkasan laporan mingguan dari 14 Februari 2025 yang ditulis oleh Haekal Yusril Faizin. Laporan ini merangkum aktivitas dan isu dari tim Data Engineer, Data Analyst, dan Data Analyst & AI.
154 -
155 -**Data Analyst**
156 -
157 -* Menyelesaikan fase kedua Dharma Dexa.
158 -* Memindahkan visualisasi data dan analitik dari Looker ke Metabase.
159 -* Mendesain ulang data DKonsul untuk struktur dan organisasi yang lebih baik.
160 -* Menangani berbagai permintaan data on-demand.
161 -
162 -**Data Analyst & AI**
163 -
164 -* Menerapkan, mengevaluasi, dan mendokumentasikan API Screening Dharma Dexa untuk diakses oleh tim Tech.
165 -* Menerapkan, mengevaluasi, dan mendokumentasikan master user GUE Ecosystem untuk diakses oleh tim Tech.
166 -* Memperbaiki masalah lonjakan sumber daya yang disebabkan oleh jadwal scraping.
167 -* Merepoint, menyelaraskan ulang, dan mendesain ulang pipeline dan database yang digunakan untuk scraping.
168 -* Menerapkan pemetaan kepatuhan dengan data terbaru dari tim kepatuhan.
169 -* Memvalidasi data, alur, dan skrip untuk kinerja laporan pengguna dokter.
170 -
171 -**Isu**
172 -
173 -* Pilihan bagan dan fleksibilitas yang terbatas dalam kustomisasi Metabase.
174 -* Kurangnya informasi mengenai database repointing MCN dari tim teknologi.
175 -* Perlu meningkatkan akurasi RAG menjadi sekitar 90%.
176 -
177 -**Langkah Selanjutnya**
178 -
179 -* Melanjutkan desain ulang data DKonsul dan migrasi ke Metabase.
180 -* Melanjutkan dengan Dharma Dexa Fase 3 dan mengembangkan Dasbor Pelacak Kunjungan AppSheet MCN.
181 -* Meningkatkan akurasi RAG, memulai scraping berulang harian untuk dasbor TikTok, dan memulai wawasan DKonsul minggu depan.
182 -
183 -**Dukungan yang Dibutuhkan**
184 -
185 -* Validasi data dan peningkatan penyaringan Dharma Dexa.
120 +
186 186  )))