RouterPlus (YC F26) @useRouterPlus

Krea 3 by @krea_ai is live on @useRouterPlus great to have partnered with the team for day 0 support would love to see examples of what you folks do with it on RouterPlus !! What models would you like us to see support next ?

RouterPlus (YC F26) @useRouterPlus

a day ago

Krea 3, the new image editing model from @krea_ai, is now on @useRouterPlus . High-quality edits in under 6 seconds. Reimagine the scene while keeping your subject consistent, or blend multiple reference images with a simple text prompt.

2 0 6 1K 0

access it here app.routerplus.com/?provider=krea

Krea 3, the new image editing model from @krea_ai, is now on @useRouterPlus . High-quality edits in under 6 seconds. Reimagine the scene while keeping your subject consistent, or blend multiple reference images with a simple text prompt.

CDMs are the future! Was great working with @scaledown_team on this release. Scaledown's purpose built CDMs - classify, extract and summarize are now available on @useRouterPlus

Neal Patel @neal_k_patel

3 days ago

You already gave the LLM the answer. So why is it writing it out from scratch? Introducing a new AI model architecture: Constrained Decoding Models (CDMs) LLMs were built to write. Most production workloads just need an answer: fast, consistent, and affordable. CDMs are

280 286 2K 1.8M 3K

ScaleDown's Constrained Decoding Models (CDMs) are now available on @useRouterPlus. You can now use their Classify, Summarize, and Extract models which feature a 1M input token context window, multimodal (text + image), and are reported to be 200x faster and 467x cheaper than traditional LLMs! Try to today at: app.routerplus.com/playground

Neal Patel @neal_k_patel

3 days ago

You already gave the LLM the answer. So why is it writing it out from scratch? Introducing a new AI model architecture: Constrained Decoding Models (CDMs) LLMs were built to write. Most production workloads just need an answer: fast, consistent, and affordable. CDMs are

280 286 2K 1.8M 3K

Self hosting has inference providers alternative now. So unless you have reasons to own hardware and self host or you are post training, everyone doesnt need to download anymore. You can access these services like subscription. Routers make switching, discovery and experimentation far more convenient than you downloading and trying. Routers are also catalog now, an active one and not a passive listing. People now go to marketplaces like @openrouter, @vercel , @useRouterPlus for their discovery vs huggingface h/t to @ParikhRajesh07

Nathan Lambert @natolambert

6 days ago

We've been monitoring a decline in HuggingFace downloads across the top open LLMs we track for interconnects. It looks like there was a slight change in counting of downloads, as we saw a ~30% download rate drop for many top models, but this is continuing over time. What else do

132 22 421 74K 119

Nimble v3 from @bespokelabsai is now FREE on RouterPlus ! check it out app.routerplus.com/models/bespoke…

Nimble is available on @useRouterPlus!

Alok Bishoyi @alokbishoyi97

a week ago

Launching Decision models on @useRouterPlus. You can now use various system 1 decision models such as Jev, @perplexity_ai Decider, @bespokelabsai Nimble, Mercury Decide, Clef, Kev 4B and Decider 2B with 3 models free !! app.routerplus.com/playground

14 9 103 8K 22

checkout decision models on routerplus.com/playground we have some free decision models as well !

Alok Bishoyi @alokbishoyi97

a week ago

Launching Decision models on @useRouterPlus. You can now use various system 1 decision models such as Jev, @perplexity_ai Decider, @bespokelabsai Nimble, Mercury Decide, Clef, Kev 4B and Decider 2B with 3 models free !! app.routerplus.com/playground

14 9 103 8K 22

btw at @useRouterPlus we have been using numerous techniques to ensure that inference providers are ACTUALLY delivering what they claim - this involves running relatively expensive live evals , checking quality and also measuring symmetric KL divergence to monitor deviations from actual expected behaviour since a lot of inference contracts go through us we can actively monitor for such discrepencies and hold providers accountable. its only done now for certain larger contracts - but we expect to roll it out to the wider platform soon

Xiaoyin Qu @quxiaoyin

2 weeks ago

Yesterday I posted about inference price war pushing margin down. But I since learned inference scammers are a thing with shady price manipulations: As inference providers, - You can lower your input token price 100x cheaper but up your output price 5x. You rank higher in

17 9 117 14K 50

Buying inference today means picking between two bad options. Commit for a year and pay for capacity you don't use. Or go serverless and get rate limited the moment you grow. But usage arrives in bursts: a weekend eval, a two-week backfill, US business hours. And not all tokens are equal. You might need BF16, not quietly quantized FP8. Served in the US. A latency target. Zero retention. Fast tokens for your product, cheap batched tokens for the rest. The capacity exists. It's just scattered across big clouds and long-tail providers you've never heard of. So we built a marketplace. Introducing the @useRouterPlus managed inference marketplace. Post the inference you need, when you need them. Commitment you are comfortable with. Providers bid. You pick the one that meets your spec. we're already on track for 1 trillion tokens a month. routerplus.com/capacity

we are starting to host small gatherings around AI and inference with the first of the series tonight at 6:30pm at Hogpatch ( pizzas and snacks included ! ). Great chance to hang out with folks thinking and building in the space. luma link below ps : we will be rebranding to @userouterplus, would love to show you what we’re upto as well!

loved the GTM brainstorming with the guys. @XLN1999 and @alokbishoyi97 are the team I'd bet my life savings on. @EVO__HQ is gonna be the biggest force in managing inference loads, will come back to this post after the demo day, and again by '28 when they hit a billion in ARR (pardon for my lack of vision if you guys get there faster) Kill the space, my Gs.

Alok Bishoyi @alokbishoyi97

a month ago

small get-together by friends and well wishers at @evo__hq before @XLN1999 and I set off to SF for YC fall batch

keyboard_arrow_left Previous keyboard_arrow_right Next

9 3 73 3K 3

inference engg chart porn inside @EVO__HQ dashboards cc @XLN1999

keyboard_arrow_left Previous keyboard_arrow_right Next

@EVO__HQ got into YC!! we are eager to talk with - engineers who are hungry to become the best in the world at inference, posttraining and distributed systems. - ops folks who have worked with datacentres and inference providers

deployed and served custom models for a big @evo__hq customer over the past week insane and rapid learnings understood their traffic patterns, setup evals - did lot of ablation runs on multiple models eventually we weren't getting enough savings, so we posttrained a model - first SFT and then other RL policies then came inference optimization setup end to end , including custom spec dec models as per their data distribution, tuning vLLM configs, quantization etc then more work around compute allocation , inference capacity planning / warming up as per traffic profiles etc all orchestrated by our in house autoresearch / AI engineer all this to ensure our customers get best bang for buck we are now rapidly onboarding inference providers who can reliably service our growing demand and if you are someone whose agentic/AI workload spends are more than $20k a month, then do reach out. We would love to figure what we could do for you!

Frontier performance with 20x cheaper cost

Alok Bishoyi @alokbishoyi97

2 months ago

At @evo__hq we hillclimbed a smarted router setup for agentic workloads ( ITSM bench by @VibrantLabsAI ) that achieves SOTA results while being 20x cost effective vs frontier models - beating as well the newly released models of Grok4.6 and Deepseek v4 pro in both quality and

2 8 33 14K 12

preach ! been telling ya’ll also the most important part is the last line. “the challenge is customizing them to an org/team/individuals requires data” this is exactly what @evo__hq solves for btw

Zain @zainhas

2 months ago

routers save money and improve quality > 35% lower cost, +1.3% better quality the challenge is customizing them to an org/team/individuals requires data

1 5 37 4K 10

“There is no best model for every task. Routing, harnesses, evals, and the right mix of open and proprietary models can radically change the economics.” exactly the thesis of us at @evo__hq btw :)

Yuchen Jin @Yuchenj_UW

2 months ago

At Databricks, AI coding token spend is growing exponentially. 1. The “efficiency frontier” matters. On Databricks Coding Bench, GLM 5.2, Opus 4.8, and GPT 5.6-Sol sit on that frontier: the best quality per dollar. 2. We see cost regressions when comparing Opus 5.0 to 4.8.

46 37 423 41K 131

Introducing EVO Router - a smart router that continuously optimizes and hill-climbs on your AI inference workloads. It learns from your code, prompts, production traffic, use cases, and SLAs, then searches for the best setup for every workload. That can mean more than choosing just a single model or routing through a classifier. @EVO__HQ can optimize across model × provider combinations, fusion systems, cascades, routing policies, and prompts — whatever the workload allows, while staying within your quality, latency, and reliability constraints. As open-source models move closer to frontier-model performance, we believe this kind of workload-specific hill-climbing will become an important part of how AI systems are deployed and operated. Our early users have seen 30–60% lower inference costs across use cases ranging from complex multi-turn agents to asynchronous batch workloads. EVO Router has also reached the Pareto frontier on several benchmarks, outperforming existing setups on cost, quality, or both.