Skip to content
View chloe4ai's full-sized avatar

Block or report chloe4ai

Block user

Prevent this user from interacting with your repositories and sending you notifications. Learn more about blocking users.

You must be logged in to block users.

Content in all repositories owned by your account will be closed.
Maximum 250 characters. Please donโ€™t include any personal information such as legal names or email addresses. This note will only be visible to you.
Report abuse

Contact GitHub support about this userโ€™s behavior. Learn more about reporting abuse.

Report abuse
chloe4ai/README.md

Hi, I'm Chloe ๐Ÿ‘‹

๐Ÿ“ SF Bay Area, CA | ๐Ÿงญ Principal PM | ๐Ÿš€ Building full-cycle AI products

Product Management LLM Evaluation RAG Recommendation Systems Python TypeScript Claude

I turn human judgment into measurable product quality. After a decade shipping 0โ†’1 and at-scale AI/ML products, I'm now building full-cycle AI tools end to end โ€” from the underlying architecture to the practical apps people actually use.



๐Ÿ’ก About Me

Most recently Principal PM at Walmart (Data & Ads Global Product Org), where I ran the human-in-the-loop evaluation program behind AI-driven products โ€” designing eval frameworks, scorecards, and annotator operations that made models measurably better.

My background blends Computer Science and an MBA (Cornell University) โ€” technical fluency paired with consulting-grade strategy. I care equally about the low-level architecture and the real-world application.

What I work on

  • ๐Ÿงช LLM & AI evaluation โ€” eval harnesses, scorecards, quality benchmarks, and human-in-the-loop pipelines
  • ๐Ÿงญ Annotator operations at scale โ€” onboarding, calibration, and quality governance across global vendor teams
  • ๐ŸŽฏ Recommendation & personalization โ€” ranking, relevance, and retention-driving ML products
  • ๐Ÿ› ๏ธ Full-cycle product building โ€” 0โ†’1 prototypes through scaled launches, hands-on as both planner and builder
  • ๐Ÿ“Š Quantitative impact โ€” every initiative tied to revenue, retention, quality, or efficiency


๐Ÿ—‚๏ธ Selected Work

I build to learn. Projects are grouped by capability, newest first within each group. Dates are when each was built (โ†’ when it last got real work, not README edits).

Status โ€” four stages of maturity, each one building on the one before:

  1. ๐Ÿ’ก Concept โ€” a short build made to argue one product position
  2. ๐Ÿ› ๏ธ Demo โ€” works end to end, no automated tests yet
  3. โœ… Tested โ€” a test suite runs in CI on every change
  4. ๐Ÿš€ Release โ€” packaged as an installable app you can download

Now building โ€” the startup

Project When Status What it demonstrates
Throughline ยท live Sep โ†’ Nov 2026 โœ… Documentation, billing and home-exercise adherence for outpatient PT (Physical Therapy) clinics, built toward a real product. One rule holds it together: the claim is derived from the note, never typed alongside it. Underneath is a tested billing engine โ€” Medicare's 8-minute rule vs. the AMA (American Medical Association) rule of eights, MPPR (Multiple Procedure Payment Reduction), assistant modifiers and contract math โ€” applied in the order that changes the dollars.

AI evaluation & measurement โ€” the thesis

Project When Status What it demonstrates
Agent Ad Measurement Lab ยท live Oct โ†’ Nov 2026 โœ… When an AI agent fetches a page with a sponsored block, the fetch proves only that the page was downloaded. This lab measures what actually reached the person โ€” inclusion in the answer, whether the sponsorship label survived, whether the tracked link survived, and whether the traffic was a live user or a crawler. Billing on fetch overcounts by 3.5ร— (3.4โ€“3.9ร— across 20 seeds), and the detector is also scored on held-out wording it was not written for. Viewability, rebuilt for agents.
LLM Eval Scorecard ยท live Aug โ†’ Oct 2026 โœ… Side-by-side human eval with the parts most scorecards skip: randomized pane order with a position-bias test, bootstrap confidence intervals on the score gap, Krippendorff's ฮฑ and weighted ฮบ across raters, and a sample-size readout. Answers can you act on this yet?, not just who won?

Ad tech, growth & marketplace โ€” the day job, built out

Project When Status What it demonstrates
Notification Lab ยท live Oct 2026 โœ… Push notifications as a retention channel, not a volume dial. A 180-day cohort simulation grid-searches 54 send policies across three personas and reports what a 30-day test cannot see: D90 retention and how many people can still be reached by push or email. Frequency capping, applied to notifications.
Ad Creative Optimizer ยท live Apr โ†’ Nov 2026 โœ… Predicts creative fatigue across Google, Meta and TikTok with an exponential-decay model over each platform's feed, and alerts before the decay shows up in ROAS. Per-platform frequency caps, because a Meta impression and a TikTok impression are not the same unit of attention.
Offsite Ads Demo ยท live Apr โ†’ Nov 2026 โœ… The off-site flow end to end โ€” objective, budget, bid type, audience, multi-placement preview, 7-day KPIs โ€” with Amazon DSP and Walmart Connect side by side. The $500 floor and the $10,000 floor select for different advertisers, and the whole build follows from that.
Mochi Market ยท live Apr 2026 ๐Ÿ› ๏ธ Sales logging, inventory forecasting and dynamic pricing for vendors who either sell out or throw out. A small marketplace business, built end to end.

Recommendation & data-driven scouting

Project When Status What it demonstrates
Adaptation Radar ยท live Jul โ†’ Oct 2026 โœ… Ranks books by screen-adaptation potential from four live public APIs, with every weight a slider so the model is something you argue with. A scheduled harvest records history, so the board shows the slope, not just the level.
StreamScope ยท live Apr โ†’ Sep 2026 โœ… A cross-platform CTV recommendation engine that unifies viewing history across Netflix, HBO Max, Hulu, Disney+ and Prime.

Product prototypes โ€” built to argue a position, not to look pretty

Each one picks a narrow problem and takes a position on it. The README in each explains the problem, the positions it defends, and what it deliberately is not.

Project When Status What it demonstrates
Readwise Learning Loop ยท live Oct โ†’ Nov 2026 โœ… What you learn in AI conversations should come back for review too. Imports a Claude or ChatGPT export and keeps the few sentences worth remembering, then reranks Daily Review by what you are working on this week โ€” a relevance score, a spacing constraint and a diversity pass, the shape of an ad-ranking stack at small scale.
Glean Compass ยท live Jul 2026 ๐Ÿ’ก Priority drift, detected. Precision over recall on purpose: two flags, not forty, and dismissal is training data rather than a delete button.
Glean EI ยท full-stack ยท live Jun 2026 ๐Ÿ› ๏ธ Proactive beats search โ€” with a real Express backend, confidence genuinely recomputes server-side and agents stream over SSE.
Glean Delivery Intelligence ยท live Jun 2026 ๐Ÿ’ก Proactive beats search โ€” but only if every pushed insight can show the weight and measured precision of the signals beneath it.
NerdWallet Money Next Steps ยท live Jun 2026 ๐Ÿ’ก ๐Ÿ› ๏ธ Sequencing beats ranking: clear the 24% APR balance before the rewards card. Plus a full-stack build on Next.js + Express + SQLite with a live funnel.
Stitch Fix Household ยท live Jun 2026 ๐Ÿ’ก Household is an account architecture, not a product category โ€” cross-category browse, shared member profiles, and recommendations that learn across people.
Lyft Verticals ยท live Jun 2026 ๐Ÿ’ก Airports, scheduled rides and event egress are three marketplaces, not three filters on one โ€” flight-aware pickup, price-lock, post-event demand staging.
Midi Health ยท live Jun 2026 ๐Ÿ’ก Five specific conversion changes to a telehealth funnel, each tied to the anxiety it removes.

Tools I built because I wanted them

Project When Status What it is
Email Finder Oct โ†’ Nov 2026 ๐Ÿš€ Chrome extension that finds someone's work email from their LinkedIn profile in one click. A free, open-source take on Wiza / Apollo that runs entirely in the browser โ€” no account, no server.
Sotto Jul โ†’ Oct 2026 ๐Ÿš€ Privacy-first on-device voice dictation for macOS and Windows, one hotkey per language. Speak softly, never type.
WeChat MCP Bridge Sep 2026 ๐Ÿ› ๏ธ Gives Claude read access to your own WeChat history on macOS after every single-tool solution broke โ€” ~15 lines of glue between two surviving projects, plus the four permission gates that cost people an afternoon.
Meeting Scribe Aug 2026 ๐Ÿš€ Menu-bar app that notices a Zoom/Meet/Teams call has started and handles the notes โ€” on-device, with consent treated as a product surface.
LinkedIn Schedule Send Aug 2026 ๐Ÿ› ๏ธ The button LinkedIn should have shipped.
AI Trackers Jun 2026 ๐Ÿ› ๏ธ Three scheduled trackers whose entire logic lives in natural-language SKILL.md files rather than code โ€” an agent reads them, gathers live data, and delivers a bilingual digest. A bet on prompts-as-programs.
Notch Jun 2026 ๐Ÿ› ๏ธ Local-first macOS work journal that traces your day into AI summaries.

Chinese history in code โ€” creative side projects

Four ink-wash animatics from Romance of the Three Kingdoms (ไธ‰ๅœ‹ๆผ”็พฉ), every scene drawn procedurally in code with a synthesized score, each exporting a real .webm (no stock footage, no AI-generated imagery). Plus one original song, made with a local music model.

Project When What it is
Three Visits ไธ‰้กง่Œ…ๅปฌ ยท live Aug 2026 The fourth film and the first with no battle: the same gate three times, the season turning behind it.
Six Expeditions ๅ…ญๅ‡บ็ฅๅฑฑ ยท live Aug 2026 Seven years, six campaigns, one returning shot โ€” repetition as the subject.
Guandu ๅฎ˜ๆธก ยท live Aug 2026 A hundred-day daylight siege over a supply line, which needed a new visual language from scratch.
Red Cliffs ่ตคๅฃ ยท live Jul 2026 The first film: one night on a river, burning ships, public-domain Ming and Qing portraits for the faces.
ๅคฉไธๅ†ๅ€Ÿ ยท live Aug 2026 An original song answering ใ€Šๅ‘ๅคฉๅ†ๅ€Ÿไบ”็™พๅนดใ€‹: lyrics and arrangement written by me, three vocal takes generated locally with ACE-Step, and lyric timing measured from the audio with Whisper plus dynamic-programming alignment.


๐Ÿ“ˆ Track Record

  • Walmart โ€” Principal PM, Data & Ads ยท lifted model response quality 42% and helpfulness 38% across 10,000+ enterprise users; scaled eval ops to 600+ annotators across 4 vendor partners
  • iHerb โ€” Lead PM ยท improved recommendation precision 33%, cut churn 22%, raised inter-annotator agreement from 71% โ†’ 94%
  • Wish โ€” Senior PM ยท boosted engagement 38% and grew active users 147% on the personalized recommendation engine
  • Amazon โ€” Senior PM ยท lifted forecast accuracy 24% and cut stockouts 18% across millions of SKUs


๐Ÿ“Š GitHub Activity

GitHub Contribution Graph



๐ŸŒฑ What I'm Focused On

  • Building a full-cycle AI product โ€” owning architecture and application end to end, starting with Throughline for outpatient PT clinics
  • Open to Product Manager roles โ€” AI/ML, evaluation, personalization, and platform products
  • Sharing what I learn โ€” practical patterns for human-in-the-loop evaluation and AI product development


๐Ÿค Connect

LinkedIn Email GitHub


"Ship measurable quality." โ€” I build evaluation systems and AI products that turn human judgment into outcomes you can prove.

Pinned Loading

  1. throughline throughline Public

    Documentation, billing and home-exercise adherence for outpatient PT clinics. One rule: the claim is derived from the note, never typed alongside it. Tested billing engine โ€” 8-minute rule vs. rule โ€ฆ

    TypeScript

  2. llm-eval-scorecard llm-eval-scorecard Public

    Blind side-by-side human eval of two model responses on a weighted rubric โ€” randomized panes to kill position bias, bootstrap CIs on the margin, inter-rater reliability. An eval you can't audit is โ€ฆ

    JavaScript

  3. notification-lab notification-lab Public

    Push notifications as a retention channel. Simulates a 180-day signup cohort under a volume-first and a fatigue-aware send policy, grid-searches 54 policies per persona, and reports what a 30-day tโ€ฆ

    Python

  4. ad-creative-optimizer ad-creative-optimizer Public

    Predicts ad-creative fatigue across Google, Meta, TikTok, Pinterest and LinkedIn with an exponential-decay model over per-platform performance feeds โ€” and alerts before the decay shows up in ROAS.

    JavaScript

  5. sotto sotto Public

    Push-to-talk dictation for macOS and Windows that inserts text wherever your cursor is. One hotkey per language, speak-to-translate, polish modes, and a personal dictionary for the proper nouns eveโ€ฆ

    Python

  6. wechat-mcp-bridge wechat-mcp-bridge Public

    Read access to your own WeChat history for Claude on macOS (WeChat 4.1.10+): ~15 lines of glue between a surviving key extractor and an MCP server, plus the four macOS permission gates. ไธญๆ–‡ README iโ€ฆ

    Python