Skip to Content

0.0
1
2
3
4
5

0 Votes

Changes for page Friday 14 February 2025

Last modified by dennis yoshikawa on 2025/02/14 01:23

From 2.4 to 2.3 From 8.1 to 7.1

From version

edited by dennis yoshikawa
on 2025/02/14 01:21

Change comment: There is no comment for this version

To version

edited by Abdurachman Putra
on 2025/02/13 09:43

Change comment: There is no comment for this version

Raw
Rendered

Summary

Page properties (3 modified, 0 added, 0 removed)

Details

Page properties

Parent

@@ -1,1 +1,1 @@
--Weekly Report.February .WebHome
++Main.PT GUE.WebHome

Author

@@ -1,1 +1,1 @@
--XWiki.dennis
++XWiki.surya

Content

@@ -10,179 +10,112 @@
  What Have You Done?
  {{/success}}
--* Airflow-airbyte maintenance
++1. xxx
++1. xxx
++1. xxx
--~1. create task for delete gcs folder table dharmadexa
--2. ⁠change incremental method in airbyte for tb)
--
--* Dkonsul
--
--~1. Deploy transformation code to production.
--2. Final QC with partnership team.
--3. Dataset migrate dataset for dashboard (Herbawell Dashboard, BRI Medika DKONSUL)
--
--* ⁠*D2D*
--
--~1. enhance logic stickness rate (mart)
--2. ⁠weekly regrup w/product
--
--* MCN
--
--~1. troubleshoot on DAG and resource
--2. ⁠repointing new database for all pipeline existing
--
--* Screening
--
--~1. regroup w/PM and DA for validate data and discuss funneling data
--2. enhance logic fact table dharmadexa
--3. ⁠preparation dharmadexa data phase 3 (funneling)
--4. ⁠testing geo.py to get city from long lat
--5. ⁠migrasi dataset cleaned_screening_merck.dim_screening_stunting to CH
--
  {{warning}}
  What Issues You Have?
  {{/warning}}
--1. That's difficulty in finding open source data quality tools is that most of them are paid.
++1. xxx
++1. xxx
++1. xxx
  {{info}}
  What Next You Will Do? (Optional)
  {{/info}}
--1. Explore more for finding open source data quality tools
--1. Tuning query for reduce cost bigquery
++1. xxx
++1. xxx
++1. xxx
  **What Support You Need? (Optional)**
--
--
------
--
--
  )))
--== (% id="cke_bm_29973S" style="display:none" %) (%%)Data Analyst ==
++== Data Engineer ==
  >What Have You Done in This Week?
  (((
--{{success}}
  What Have You Done?
--{{/success}}
--1. **Dharma Dexa Phase 2** – Completed the second phase of Dharma Dexa.
--1. **Migration from Looker to Metabase** – Transitioning data visualization and analytics from Looker to Metabase.
--1. **Redesigned DKonsul Data** – Improved the structure and organization of DKonsul data.
--1. **Ad-hoc Requests** – Handled various on-demand data requests.
++1. xxx
++1. xxx
++1. xxx
--{{warning}}
  What Issues You Have?
--{{/warning}}
--1. **Metabase Limitations** – Limited chart options and flexibility in customization, particularly a lack of aggregation functions.
++1. xxx
++1. xxx
++1. xxx
--{{info}}
  What Next You Will Do? (Optional)
--{{/info}}
--1. **Continue Redesigning DKonsul Data**
--1*. Refining the data funnel from consultation → prescription → transaction.
--1. **Continue Migration to Metabase** – Ensuring a smooth transition from Looker to Metabase.
--1. **Dharma Dexa Phase 3** – Proceeding with the next phase of the Dharma Dexa project.
--1. **AppSheet MCN Visit Tracker Dashboard** – Developing and optimizing the dashboard.
++1. xxx
++1. xxx
++1. xxx
--**What Support You Need? (Optional)**
--
--1. **Data Validation** – Ensuring data accuracy and consistency.
--1. **Dharma Dexa Screening Enhancements**
--1*. Assigning a **new screening ID** for each event, especially if different questions and inputs are involved.
--1*. Adding **location input (province, city)** for better analysis.
++What Support You Need? (Optional)
  )))
++== Data Analyst ==
------
--
--== Data Analyst & AI ==
--
  >What Have You Done in This Week?
  (((
--{{success}}
  What Have You Done?
--{{/success}}
--**AUTOMARK**
++1. xxx
++1. xxx
++1. xxx
--1. Deploy, evaluate and making documentation of **Screening Dharma Dexa API** to be accessed by Tech team. The API is deployed at [[https:~~/~~/datalake.ptgue.com/v1/users_dd>>https://datalake.ptgue.com/v1/users_dd]] and the **documentation is already sent to Tech team**. **The API could be accessed using prompt** to retrieve user that relevant to the prompt. Per 13 Feb 2024, **the RAG Accuracy is 87,50%**
--1. Deploy, evaluate and making documentation of **master user GUE Ecosystem** to be accessed by Tech team. The API is deployed at [[https:~~/~~/datalake.ptgue.com/v1/users>>https://datalake.ptgue.com/v1/users_dd]] and the **documentation is already sent to Tech team**. **The API is already tested by Tech team and have no issues.**
++What Issues You Have?
--**MCN**
++1. xxx
++1. xxx
++1. xxx
--1. Fixing resource spike issue caused by scraping schedule. The issue is already fixed and pass the test for 3 days (wednesday, thursday, and friday). **Scraping time is decreased from 1 minute per user to the maximum of +-20 seconds per user.** **(Pairing with Syifa-DE)**
--1. **Repoint, re-align, and redesign the pipeline and database** that being consumed for scrapping.** (Pairing with Syifa-DE)**
++What Next You Will Do? (Optional)
--**Automation**
++1. xxx
++1. xxx
++1. xxx
--1. **Implement compliance mapping** with the newest data from compliance team
--1. Data, flow, and script validation for user report performance doctor. **The sample report is already validated by dr.Astrid**
++What Support You Need? (Optional)
++)))
--**Others**
++== Data Analyst & AI ==
--1. Reqeust + enhance dashboard merck
--1. Request dkonsul data for online doctors, transactions, prescriptions, Dexa prescriptions, comparison new users january
--1. Request data ICD-10
++>What Have You Done in This Week?
++(((
++{{success}}
++What Have You Done?
++{{/success}}
++
++1. xxx
++1. xxx
++1. xxx
++
  {{warning}}
  What Issues You Have?
  {{/warning}}
--1. There is no info regarding database repointing of MCN from tech team. So, the data is not updated. Already solved by coordinating with Product Team
--1. Need to enhance the RAG accuracy to around 90%
++1. xxx
++1. xxx
++1. xxx
  {{info}}
  What Next You Will Do? (Optional)
  {{/info}}
--1. Increase RAG accuracy by adding more train query LLM
--1. Start daily recurring scraping for tiktok dashboard
--1. Start dkonsul insight next week
++1. xxx
++1. xxx
++1. xxx
  **What Support You Need? (Optional)**
--
--=== Summary ===
--
--Berikut ringkasan laporan mingguan dari 14 Februari 2025 yang ditulis oleh Haekal Yusril Faizin. Laporan ini merangkum aktivitas dan isu dari tim Data Engineer, Data Analyst, dan Data Analyst & AI.
--
--**Data Analyst**
--
--* Menyelesaikan fase kedua Dharma Dexa.
--* Memindahkan visualisasi data dan analitik dari Looker ke Metabase.
--* Mendesain ulang data DKonsul untuk struktur dan organisasi yang lebih baik.
--* Menangani berbagai permintaan data on-demand.
--
--**Data Analyst & AI**
--
--* Menerapkan, mengevaluasi, dan mendokumentasikan API Screening Dharma Dexa untuk diakses oleh tim Tech.
--* Menerapkan, mengevaluasi, dan mendokumentasikan master user GUE Ecosystem untuk diakses oleh tim Tech.
--* Memperbaiki masalah lonjakan sumber daya yang disebabkan oleh jadwal scraping.
--* Merepoint, menyelaraskan ulang, dan mendesain ulang pipeline dan database yang digunakan untuk scraping.
--* Menerapkan pemetaan kepatuhan dengan data terbaru dari tim kepatuhan.
--* Memvalidasi data, alur, dan skrip untuk kinerja laporan pengguna dokter.
--
--**Isu**
--
--* Pilihan bagan dan fleksibilitas yang terbatas dalam kustomisasi Metabase.
--* Kurangnya informasi mengenai database repointing MCN dari tim teknologi.
--* Perlu meningkatkan akurasi RAG menjadi sekitar 90%.
--
--**Langkah Selanjutnya**
--
--* Melanjutkan desain ulang data DKonsul dan migrasi ke Metabase.
--* Melanjutkan dengan Dharma Dexa Fase 3 dan mengembangkan Dasbor Pelacak Kunjungan AppSheet MCN.
--* Meningkatkan akurasi RAG, memulai scraping berulang harian untuk dasbor TikTok, dan memulai wawasan DKonsul minggu depan.
--
--**Dukungan yang Dibutuhkan**
--
--* Validasi data dan peningkatan penyaringan Dharma Dexa.
++
  )))