[{"data":1,"prerenderedAt":263},["ShallowReactive",2],{"blog-msty-nexus-0.2.0":3,"surround-msty-nexus-0.2.0":223,"i-tabler:menu-2":228,"i-tabler:download":233,"i-tabler:chevron-down":235,"i-tabler:route":237,"i-tabler:key":239,"i-tabler:activity":241,"i-tabler:arrow-right":243,"i-tabler:mail":245,"i-tabler:brand-discord":247,"i-tabler:brand-x":249,"i-tabler:brand-youtube":251,"i-tabler:brand-linkedin":253,"i-tabler:brand-facebook":255,"i-tabler:brand-instagram":257,"i-tabler:brand-tiktok":259,"i-tabler:arrow-up-right":261},{"id":4,"title":5,"author":6,"body":7,"canonical":208,"date":209,"description":210,"extension":211,"image":14,"meta":212,"navigation":213,"ogImage":208,"path":214,"seo":215,"stem":216,"tags":217,"twitterCard":221,"__hash__":222},"blog/blog/msty-nexus-0.2.0.md","Msty Nexus 0.2.0: A Clearer Gateway for Local Runtimes, Routes, and Clients","Nancy Parajuli",{"type":8,"value":9,"toc":195},"minimark",[10,15,19,22,27,30,38,41,60,64,67,70,73,76,80,83,86,89,92,95,99,102,105,108,112,115,118,122,125,128,131,135,138,141,144,147,151,154,177,181,184],[11,12],"blog-image",{"alt":13,"src":14},"Msty Nexus 0.2.0 release artwork featuring Smart Route, runtime discovery, and clearer gateway controls","/blog/msty-nexus-0-2-0/preview-image-0.2.0.webp",[16,17,18],"p",{},"Msty Nexus 0.2.0 makes the Nexus gateway easier to route through, inspect, and operate.",[16,20,21],{},"This release adds Smart Route for controlled request routing, local runtime discovery for reusing existing services, preset-scoped acceleration for explicit speedups, token-level usage reporting, clearer endpoints, renameable client tokens, smoother onboarding, and cleaner model labeling.",[23,24,26],"h2",{"id":25},"smart-route-gives-nexus-a-routing-layer","Smart Route Gives Nexus A Routing Layer",[16,28,29],{},"Smart Route is the main addition in Msty Nexus 0.2.0.",[16,31,32,33,37],{},"It lets Nexus expose a route pack as a stable ",[34,35,36],"strong",{},"@route/{slug}"," model identifier, then resolve each generation request to a concrete target model through the gateway. Connected clients can call one consistent value while Nexus keeps the selected target and fallback path inspectable.",[16,39,40],{},"Smart Routes help with:",[42,43,44,48,51,54,57],"ul",{},[45,46,47],"li",{},"Reducing repeated manual model selection.",[45,49,50],{},"Making routing choices easier to review.",[45,52,53],{},"Keeping fallback behavior explicit.",[45,55,56],{},"Giving clients one consistent model value to call.",[45,58,59],{},"Making multi-model workflows easier to organize.",[23,61,63],{"id":62},"existing-local-runtimes-are-easier-to-reuse","Existing Local Runtimes Are Easier To Reuse",[16,65,66],{},"Msty Nexus 0.2.0 detects supported local runtimes that are already running so that they can be easily added to Nexus.",[16,68,69],{},"This includes runtimes such as Ollama, llama.cpp, LM Studio, vLLM, and LiteLLM. Discovery is read-only, stays on the local machine, and returns safe details such as detected candidates, already registered endpoints, model counts, and model previews.",[16,71,72],{},"When a detected runtime is registered, Nexus verifies the endpoint, adds it as a local provider, enables automatic model listing, and does not store credentials for that runtime.",[16,74,75],{},"This makes existing local infrastructure easier to reuse within Nexus.",[23,77,79],{"id":78},"speculative-decoding","Speculative Decoding",[16,81,82],{},"Speculative decoding is now available and can be added as presets. Speculative decoding can drastically speed up text generation of LLMs.",[16,84,85],{},"When a request calls the target model directly, Nexus leaves it unaccelerated. Acceleration only applies when the request uses an accelerated preset slug, where Nexus can validate the profile and route through the preset-specific runtime configuration.",[16,87,88],{},"For llama.cpp presets, acceleration can pair the chat model with a smaller compatible helper model. For Nexus-managed MLX presets, Nexus supports compatible helper-model acceleration and native MTP acceleration where available.",[16,90,91],{},"For speed-focused workflows, the preset carries the acceleration intent, compatibility can be checked before use, the profile can be applied or disabled, and usage stats can show whether the faster path is reducing response time.",[16,93,94],{},"Faster responses are easier to evaluate when the target model, helper model, and acceleration profile remain explicit in the preset.",[23,96,98],{"id":97},"usage-reporting-adds-client-attribution","Usage Reporting Adds Client Attribution",[16,100,101],{},"Nexus 0.2.0 gives usage reporting more detail across connected clients, routed requests, and accelerated presets.",[16,103,104],{},"With token-level reporting, each gateway request can be tied to the local Nexus token that authenticated it. Usage can be filtered or grouped by tokenId, which gives Nexus a stable way to connect activity back to the client that made the request.",[16,106,107],{},"Route and acceleration reporting add more operational detail. Nexus can show route-pack activity, selected targets, fallback reasons, provider and model usage, accelerated preset activity, token volume, and tool-call counts.",[23,109,111],{"id":110},"client-tokens-are-easier-to-review","Client Tokens Are Easier To Review",[16,113,114],{},"Client token labels can now be renamed.",[16,116,117],{},"Renameable labels keep token lists easier to review and make token-level usage reporting more useful, because each label can reflect the client, integration, or workflow it represents now.",[23,119,121],{"id":120},"model-sources-are-easier-to-read","Model Sources Are Easier To Read",[16,123,124],{},"Model and provider labels help to make models easier to identify when reviewing model lists.",[16,126,127],{},"This release improves how Nexus names local runtime providers, detected local APIs, hosted providers, runtime catalog entries, Hugging Face sources, and imported files making it easier to understand where a model comes from and how Nexus will route to it.",[16,129,130],{},"Cleaner labeling reduces confusion during everyday model selection, especially when several sources are connected.",[23,132,134],{"id":133},"setup-paths-and-endpoints-are-clearer","Setup Paths And Endpoints Are Clearer",[16,136,137],{},"Setup now separates local runtime work from hosted provider configuration, guiding users toward installing or reusing a runtime, finding one already running, or adding a provider.",[16,139,140],{},"Connected-client onboarding is clearer as well, including workflows for tools such as Vibe CLI and Msty Claw, where users need the right endpoint and token path before requests can flow through Nexus.",[16,142,143],{},"Endpoint handling also improves, with the gateway panel distinguishing Gateway URL from OpenAI-compatible URL, supporting direct copy actions, and pointing users toward client token management when authentication is needed.",[16,145,146],{},"Together, these changes reduce friction in places where precision matters most, including runtime selection, provider configuration, endpoint choice, and client authentication.",[23,148,150],{"id":149},"nexus-020-smooths-everyday-workflows","Nexus 0.2.0 Smooths Everyday Workflows",[16,152,153],{},"In addition to the above, we also released the following enhancements and fixes:",[42,155,156,159,162,165,168,171,174],{},[45,157,158],{},"Smart Route pack availability validation is stricter.",[45,160,161],{},"Provider models stay out of public selectors when they should not be shown.",[45,163,164],{},"Non-GGUF results are filtered out for llama.cpp installs.",[45,166,167],{},"Duplicate preset behavior is cleaned up.",[45,169,170],{},"Runtime restarts are more reliable after network exposure changes.",[45,172,173],{},"Model search cards and local model workflows are easier to use.",[45,175,176],{},"App focus, popup placement, tray icons, and packaging behavior are more polished.",[23,178,180],{"id":179},"a-clearer-operating-layer-for-nexus","A Clearer Operating Layer For Nexus",[16,182,183],{},"The release centers on Smart Route, which adds a structured way to send generation requests through route packs with explicit fallback behavior. Runtime discovery, preset-scoped acceleration, token-level usage reporting, clearer endpoints, renameable client tokens, and cleaner model labels round out the workflow around it.",[16,185,186,187,194],{},"Update to Msty Nexus 0.2.0 to try Smart Route, scan for runtimes already running on your machine, review the client tokens and model paths connected through Nexus, and see the ",[188,189,193],"a",{"href":190,"rel":191},"https://msty.ai/nexus/changelog",[192],"nofollow","full 0.2.0 changelog"," for the complete list of changes.",{"title":196,"searchDepth":197,"depth":197,"links":198},"",2,[199,200,201,202,203,204,205,206,207],{"id":25,"depth":197,"text":26},{"id":62,"depth":197,"text":63},{"id":78,"depth":197,"text":79},{"id":97,"depth":197,"text":98},{"id":110,"depth":197,"text":111},{"id":120,"depth":197,"text":121},{"id":133,"depth":197,"text":134},{"id":149,"depth":197,"text":150},{"id":179,"depth":197,"text":180},null,"20260715","Msty Nexus 0.2.0 makes the Nexus gateway easier to route through, inspect, and operate with Smart Route, local runtime discovery, clearer endpoints, and better client usage visibility.","md",{},true,"/blog/msty-nexus-0.2.0",{"title":5,"description":210},"blog/msty-nexus-0.2.0",[218,219,220],"msty-nexus","release-notes","ai-gateway","summary_large_image","vVpHozbWRfqKuSTgXdNPoGi9GNEyh_iF65b9-jh8VZQ",[208,224],{"title":225,"path":226,"stem":227,"children":-1},"Msty Claw 0.12.0: Keep Context Close","/blog/msty-claw-0.12.0","blog/msty-claw-0.12.0",{"left":229,"top":229,"width":230,"height":230,"rotate":229,"vFlip":231,"hFlip":231,"body":232},0,24,false,"\u003Cpath fill=\"none\" stroke=\"currentColor\" stroke-linecap=\"round\" stroke-linejoin=\"round\" stroke-width=\"2\" d=\"M4 6h16M4 12h16M4 18h16\"/>",{"left":229,"top":229,"width":230,"height":230,"rotate":229,"vFlip":231,"hFlip":231,"body":234},"\u003Cpath fill=\"none\" stroke=\"currentColor\" stroke-linecap=\"round\" stroke-linejoin=\"round\" stroke-width=\"2\" d=\"M4 17v2a2 2 0 0 0 2 2h12a2 2 0 0 0 2-2v-2M7 11l5 5l5-5m-5-7v12\"/>",{"left":229,"top":229,"width":230,"height":230,"rotate":229,"vFlip":231,"hFlip":231,"body":236},"\u003Cpath fill=\"none\" stroke=\"currentColor\" stroke-linecap=\"round\" stroke-linejoin=\"round\" stroke-width=\"2\" d=\"m6 9l6 6l6-6\"/>",{"left":229,"top":229,"width":230,"height":230,"rotate":229,"vFlip":231,"hFlip":231,"body":238},"\u003Cpath fill=\"none\" stroke=\"currentColor\" stroke-linecap=\"round\" stroke-linejoin=\"round\" stroke-width=\"2\" d=\"M3 19a2 2 0 1 0 4 0a2 2 0 0 0-4 0M19 7a2 2 0 1 0 0-4a2 2 0 0 0 0 4m-8 12h5.5a3.5 3.5 0 0 0 0-7h-8a3.5 3.5 0 0 1 0-7H13\"/>",{"left":229,"top":229,"width":230,"height":230,"rotate":229,"vFlip":231,"hFlip":231,"body":240},"\u003Cpath fill=\"none\" stroke=\"currentColor\" stroke-linecap=\"round\" stroke-linejoin=\"round\" stroke-width=\"2\" d=\"m16.555 3.843l3.602 3.602a2.877 2.877 0 0 1 0 4.069l-2.643 2.643a2.877 2.877 0 0 1-4.069 0l-.301-.301l-6.558 6.558a2 2 0 0 1-1.239.578L5.172 21H4a1 1 0 0 1-.993-.883L3 20v-1.172a2 2 0 0 1 .467-1.284l.119-.13L4 17h2v-2h2v-2l2.144-2.144l-.301-.301a2.877 2.877 0 0 1 0-4.069l2.643-2.643a2.877 2.877 0 0 1 4.069 0M15 9h.01\"/>",{"left":229,"top":229,"width":230,"height":230,"rotate":229,"vFlip":231,"hFlip":231,"body":242},"\u003Cpath fill=\"none\" stroke=\"currentColor\" stroke-linecap=\"round\" stroke-linejoin=\"round\" stroke-width=\"2\" d=\"M3 12h4l3 8l4-16l3 8h4\"/>",{"left":229,"top":229,"width":230,"height":230,"rotate":229,"vFlip":231,"hFlip":231,"body":244},"\u003Cpath fill=\"none\" stroke=\"currentColor\" stroke-linecap=\"round\" stroke-linejoin=\"round\" stroke-width=\"2\" d=\"M5 12h14m-6 6l6-6m-6-6l6 6\"/>",{"left":229,"top":229,"width":230,"height":230,"rotate":229,"vFlip":231,"hFlip":231,"body":246},"\u003Cg fill=\"none\" stroke=\"currentColor\" stroke-linecap=\"round\" stroke-linejoin=\"round\" stroke-width=\"2\">\u003Cpath d=\"M3 7a2 2 0 0 1 2-2h14a2 2 0 0 1 2 2v10a2 2 0 0 1-2 2H5a2 2 0 0 1-2-2z\"/>\u003Cpath d=\"m3 7l9 6l9-6\"/>\u003C/g>",{"left":229,"top":229,"width":230,"height":230,"rotate":229,"vFlip":231,"hFlip":231,"body":248},"\u003Cg fill=\"none\" stroke=\"currentColor\" stroke-linecap=\"round\" stroke-linejoin=\"round\" stroke-width=\"2\">\u003Cpath d=\"M8 12a1 1 0 1 0 2 0a1 1 0 0 0-2 0m6 0a1 1 0 1 0 2 0a1 1 0 0 0-2 0\"/>\u003Cpath d=\"M15.5 17c0 1 1.5 3 2 3c1.5 0 2.833-1.667 3.5-3c.667-1.667.5-5.833-1.5-11.5c-1.457-1.015-3-1.34-4.5-1.5l-.972 1.923a11.9 11.9 0 0 0-4.053 0L9 4c-1.5.16-3.043.485-4.5 1.5c-2 5.667-2.167 9.833-1.5 11.5c.667 1.333 2 3 3.5 3c.5 0 2-2 2-3\"/>\u003Cpath d=\"M7 16.5c3.5 1 6.5 1 10 0\"/>\u003C/g>",{"left":229,"top":229,"width":230,"height":230,"rotate":229,"vFlip":231,"hFlip":231,"body":250},"\u003Cpath fill=\"none\" stroke=\"currentColor\" stroke-linecap=\"round\" stroke-linejoin=\"round\" stroke-width=\"2\" d=\"m4 4l11.733 16H20L8.267 4zm0 16l6.768-6.768m2.46-2.46L20 4\"/>",{"left":229,"top":229,"width":230,"height":230,"rotate":229,"vFlip":231,"hFlip":231,"body":252},"\u003Cg fill=\"none\" stroke=\"currentColor\" stroke-linecap=\"round\" stroke-linejoin=\"round\" stroke-width=\"2\">\u003Cpath d=\"M2 8a4 4 0 0 1 4-4h12a4 4 0 0 1 4 4v8a4 4 0 0 1-4 4H6a4 4 0 0 1-4-4z\"/>\u003Cpath d=\"m10 9l5 3l-5 3z\"/>\u003C/g>",{"left":229,"top":229,"width":230,"height":230,"rotate":229,"vFlip":231,"hFlip":231,"body":254},"\u003Cg fill=\"none\" stroke=\"currentColor\" stroke-linecap=\"round\" stroke-linejoin=\"round\" stroke-width=\"2\">\u003Cpath d=\"M8 11v5m0-8v.01M12 16v-5m4 5v-3a2 2 0 1 0-4 0\"/>\u003Cpath d=\"M3 7a4 4 0 0 1 4-4h10a4 4 0 0 1 4 4v10a4 4 0 0 1-4 4H7a4 4 0 0 1-4-4z\"/>\u003C/g>",{"left":229,"top":229,"width":230,"height":230,"rotate":229,"vFlip":231,"hFlip":231,"body":256},"\u003Cpath fill=\"none\" stroke=\"currentColor\" stroke-linecap=\"round\" stroke-linejoin=\"round\" stroke-width=\"2\" d=\"M7 10v4h3v7h4v-7h3l1-4h-4V8a1 1 0 0 1 1-1h3V3h-3a5 5 0 0 0-5 5v2z\"/>",{"left":229,"top":229,"width":230,"height":230,"rotate":229,"vFlip":231,"hFlip":231,"body":258},"\u003Cg fill=\"none\" stroke=\"currentColor\" stroke-linecap=\"round\" stroke-linejoin=\"round\" stroke-width=\"2\">\u003Cpath d=\"M4 8a4 4 0 0 1 4-4h8a4 4 0 0 1 4 4v8a4 4 0 0 1-4 4H8a4 4 0 0 1-4-4z\"/>\u003Cpath d=\"M9 12a3 3 0 1 0 6 0a3 3 0 0 0-6 0m7.5-4.5v.01\"/>\u003C/g>",{"left":229,"top":229,"width":230,"height":230,"rotate":229,"vFlip":231,"hFlip":231,"body":260},"\u003Cpath fill=\"none\" stroke=\"currentColor\" stroke-linecap=\"round\" stroke-linejoin=\"round\" stroke-width=\"2\" d=\"M21 7.917v4.034A9.95 9.95 0 0 1 16 10v4.5a6.5 6.5 0 1 1-8-6.326V12.5a2.5 2.5 0 1 0 4 2V3h4.083A6.005 6.005 0 0 0 21 7.917\"/>",{"left":229,"top":229,"width":230,"height":230,"rotate":229,"vFlip":231,"hFlip":231,"body":262},"\u003Cpath fill=\"none\" stroke=\"currentColor\" stroke-linecap=\"round\" stroke-linejoin=\"round\" stroke-width=\"2\" d=\"M17 7L7 17M8 7h9v9\"/>",1784224994941]