Hew Li Yang

I'm a developer living in Kuala Lumpur and Singapore. I have a background in data science, which just means I took many math and statistics classes and few CS ones, but nowadays I would classify myself as more of a software engineer.

Today, I work at brightriver.ai where I joined as engineer #0 to build agents for financial work, particularly in streamlining due diligence and deal making.

I've been building on top of LLMs since mid-2023, when I had the privilege of interning at GIC's research team.

I have a number of OSS contributions - mostly for tools that I use daily.

Recent GitHub Contributions

Pull Requests

open ci(lint): black not running with check litellm

open fix(bedrock-converse): cache control not applied to messages with assistant or tool role litellm

merged Add `model_request_stream_sync` to direct API pydantic-ai

merged fix(bedrock): wrong system prompt transformation litellm

merged fix: claude haiku cache read pricing per token litellm

open chore: xlsx improvements markitdown

Issues

open [Bug: Anthropic Bedrock Converse]: assistant & tool messages dropping cache points litellm

closed sync method for direct api `model_request_stream` pydantic-ai

open `escape_special_characters` is not exhaustive prompt-poet

open difference in caching behavior between `Anthropic` and `AnthropicBedrock` anthropic-sdk-python

closed [Bug]: wrong price per token for haiku cache read litellm

closed minimum area for images & vector graphics RAG

open mermaid temp files in subfolders not cleaned up quarto-cli