Changes for page Friday 14 February 2025

Summary

• Page properties (3 modified, 0 added, 0 removed)

Details

Page properties

Parent

...	...	@@ -1,1 +1,1 @@
1		-Main.PT GUE.WebHome
	1	+Weekly Report.February .WebHome

Author

...	...	@@ -1,1 +1,1 @@
1		-XWiki.surya
	1	+XWiki.dennis

Content

...	...	@@ -10,10 +10,30 @@
10	10	What Have You Done?
11	11	{{/success}}
12	12
13		-1. xxx
14		-1. xxx
15		-1. xxx
	13	+* Airflow-airbyte maintenance
16	16
	15	+~1. create task for delete gcs folder table dharmadexa
	16	+2. ⁠change incremental method in airbyte for tb)
	17	+
	18	+
	19	+* ⁠*D2D*
	20	+
	21	+~1. enhance logic stickness rate (mart)
	22	+2. ⁠weekly regrup w/product
	23	+
	24	+* MCN
	25	+
	26	+~1. troubleshoot on DAG and resource
	27	+2. ⁠repointing new database for all pipeline existing
	28	+
	29	+* Screening
	30	+
	31	+~1. regroup w/PM and DA for validate data and discuss funneling data
	32	+2. enhance logic fact table dharmadexa
	33	+3. ⁠preparation dharmadexa data phase 3 (funneling)
	34	+4. ⁠testing geo.py to get city from long lat
	35	+5. ⁠migrasi dataset cleaned_screening_merck.dim_screening_stunting to CH
	36	+
17	17	{{warning}}
18	18	What Issues You Have?
19	19	{{/warning}}
...	...	@@ -31,91 +31,136 @@
31	31	1. xxx
32	32
33	33	**What Support You Need? (Optional)**
	54	+
	55	+
	56	+----
	57	+
	58	+
34	34	)))
35	35
36	36
37		-== Data Engineer ==
	62	+== (% id="cke_bm_29973S" style="display:none" %) (%%)Data Analyst ==
38	38
39	39	>What Have You Done in This Week?
40	40
41	41	(((
	67	+{{success}}
42	42	What Have You Done?
	69	+{{/success}}
43	43
44		-1. xxx
45		-1. xxx
46		-1. xxx
	71	+1. **Dharma Dexa Phase 2** – Completed the second phase of Dharma Dexa.
	72	+1. **Migration from Looker to Metabase** – Transitioning data visualization and analytics from Looker to Metabase.
	73	+1. **Redesigned DKonsul Data** – Improved the structure and organization of DKonsul data.
	74	+1. **Ad-hoc Requests** – Handled various on-demand data requests.
47	47
	76	+{{warning}}
48	48	What Issues You Have?
	78	+{{/warning}}
49	49
50		-1. xxx
51		-1. xxx
52		-1. xxx
	80	+1. **Metabase Limitations** – Limited chart options and flexibility in customization, particularly a lack of aggregation functions.
53	53
	82	+{{info}}
54	54	What Next You Will Do? (Optional)
	84	+{{/info}}
55	55
56		-1. xxx
57		-1. xxx
58		-1. xxx
	86	+1. **Continue Redesigning DKonsul Data**
	87	+1*. Refining the data funnel from consultation → prescription → transaction.
	88	+1. **Continue Migration to Metabase** – Ensuring a smooth transition from Looker to Metabase.
	89	+1. **Dharma Dexa Phase 3** – Proceeding with the next phase of the Dharma Dexa project.
	90	+1. **AppSheet MCN Visit Tracker Dashboard** – Developing and optimizing the dashboard.
59	59
60		-What Support You Need? (Optional)
	92	+**What Support You Need? (Optional)**
	93	+
	94	+1. **Data Validation** – Ensuring data accuracy and consistency.
	95	+1. **Dharma Dexa Screening Enhancements**
	96	+1*. Assigning a **new screening ID** for each event, especially if different questions and inputs are involved.
	97	+1*. Adding **location input (province, city)** for better analysis.
61	61	)))
62	62
63		-== Data Analyst ==
64	64
	101	+----
	102	+
	103	+== Data Analyst & AI ==
	104	+
65	65	>What Have You Done in This Week?
66	66
67	67	(((
	108	+{{success}}
68	68	What Have You Done?
	110	+{{/success}}
69	69
70		-1. xxx
71		-1. xxx
72		-1. xxx
	112	+**AUTOMARK**
73	73
74		-What Issues You Have?
	114	+1. Deploy, evaluate and making documentation of **Screening Dharma Dexa API** to be accessed by Tech team. The API is deployed at [[https:~~/~~/datalake.ptgue.com/v1/users_dd>>https://datalake.ptgue.com/v1/users_dd]] and the **documentation is already sent to Tech team**. **The API could be accessed using prompt** to retrieve user that relevant to the prompt. Per 13 Feb 2024, **the RAG Accuracy is 87,50%**
	115	+1. Deploy, evaluate and making documentation of **master user GUE Ecosystem** to be accessed by Tech team. The API is deployed at [[https:~~/~~/datalake.ptgue.com/v1/users>>https://datalake.ptgue.com/v1/users_dd]] and the **documentation is already sent to Tech team**. **The API is already tested by Tech team and have no issues.**
75	75
76		-1. xxx
77		-1. xxx
78		-1. xxx
	117	+**MCN**
79	79
80		-What Next You Will Do? (Optional)
	119	+1. Fixing resource spike issue caused by scraping schedule. The issue is already fixed and pass the test for 3 days (wednesday, thursday, and friday). **Scraping time is decreased from 1 minute per user to the maximum of +-20 seconds per user.** **(Pairing with Syifa-DE)**
	120	+1. **Repoint, re-align, and redesign the pipeline and database** that being consumed for scrapping.** (Pairing with Syifa-DE)**
81	81
82		-1. xxx
83		-1. xxx
84		-1. xxx
	122	+**Automation**
85	85
86		-What Support You Need? (Optional)
87		-)))
	124	+1. **Implement compliance mapping** with the newest data from compliance team
	125	+1. Data, flow, and script validation for user report performance doctor. **The sample report is already validated by dr.Astrid**
88	88
89		-== Data Analyst & AI ==
	127	+**Others**
90	90
91		->What Have You Done in This Week?
	129	+1. Reqeust + enhance dashboard merck
	130	+1. Request dkonsul data for online doctors, transactions, prescriptions, Dexa prescriptions, comparison new users january
	131	+1. Request data ICD-10
92	92
93		-(((
94		-{{success}}
95		-What Have You Done?
96		-{{/success}}
97		-
98		-1. xxx
99		-1. xxx
100		-1. xxx
101		-
102	102	{{warning}}
103	103	What Issues You Have?
104	104	{{/warning}}
105	105
106		-1. xxx
107		-1. xxx
108		-1. xxx
	137	+1. There is no info regarding database repointing of MCN from tech team. So, the data is not updated. Already solved by coordinating with Product Team
	138	+1. Need to enhance the RAG accuracy to around 90%
109	109
110	110	{{info}}
111	111	What Next You Will Do? (Optional)
112	112	{{/info}}
113	113
114		-1. xxx
115		-1. xxx
116		-1. xxx
	144	+1. Increase RAG accuracy by adding more train query LLM
	145	+1. Start daily recurring scraping for tiktok dashboard
	146	+1. Start dkonsul insight next week
117	117
118	118	**What Support You Need? (Optional)**
119	119
120		-
	150	+
	151	+=== Summary ===
	152	+
	153	+Berikut ringkasan laporan mingguan dari 14 Februari 2025 yang ditulis oleh Haekal Yusril Faizin. Laporan ini merangkum aktivitas dan isu dari tim Data Engineer, Data Analyst, dan Data Analyst & AI.
	154	+
	155	+**Data Analyst**
	156	+
	157	+* Menyelesaikan fase kedua Dharma Dexa.
	158	+* Memindahkan visualisasi data dan analitik dari Looker ke Metabase.
	159	+* Mendesain ulang data DKonsul untuk struktur dan organisasi yang lebih baik.
	160	+* Menangani berbagai permintaan data on-demand.
	161	+
	162	+**Data Analyst & AI**
	163	+
	164	+* Menerapkan, mengevaluasi, dan mendokumentasikan API Screening Dharma Dexa untuk diakses oleh tim Tech.
	165	+* Menerapkan, mengevaluasi, dan mendokumentasikan master user GUE Ecosystem untuk diakses oleh tim Tech.
	166	+* Memperbaiki masalah lonjakan sumber daya yang disebabkan oleh jadwal scraping.
	167	+* Merepoint, menyelaraskan ulang, dan mendesain ulang pipeline dan database yang digunakan untuk scraping.
	168	+* Menerapkan pemetaan kepatuhan dengan data terbaru dari tim kepatuhan.
	169	+* Memvalidasi data, alur, dan skrip untuk kinerja laporan pengguna dokter.
	170	+
	171	+**Isu**
	172	+
	173	+* Pilihan bagan dan fleksibilitas yang terbatas dalam kustomisasi Metabase.
	174	+* Kurangnya informasi mengenai database repointing MCN dari tim teknologi.
	175	+* Perlu meningkatkan akurasi RAG menjadi sekitar 90%.
	176	+
	177	+**Langkah Selanjutnya**
	178	+
	179	+* Melanjutkan desain ulang data DKonsul dan migrasi ke Metabase.
	180	+* Melanjutkan dengan Dharma Dexa Fase 3 dan mengembangkan Dasbor Pelacak Kunjungan AppSheet MCN.
	181	+* Meningkatkan akurasi RAG, memulai scraping berulang harian untuk dasbor TikTok, dan memulai wawasan DKonsul minggu depan.
	182	+
	183	+**Dukungan yang Dibutuhkan**
	184	+
	185	+* Validasi data dan peningkatan penyaringan Dharma Dexa.
121	121	)))