Recently, I wrote about why you should write your own benchmarks for language models to see how they work for your app. I also shared a ready-to-use Jupyter Notebook that allows you to evaluate language models on Ollama. I've just published a new version of the notebook which now supports any language model host that exposes OpenAI-compatible APIs. Like the previous version, the new notebook shows you how well your select language models perform for each scenario, and overall. What's changed,...| Waldek Mastykarz
When it comes to language models, we tend to look at benchmarks to decide which model is the best to use in our application. But benchmarks only tell half a story. Unless you're building an all-purpose chat application, what you should be actually looking at is how well a model works for your application. This article is based on a benchmark I put together to evaluate which of the language models available on Ollama is best suited for Dev Proxy. You can find the working prototype on GitHub. I...| Waldek Mastykarz
When you submit data to an API, the character encoding is crucial to ensure that the data is processed properly, especially if you're working with UTF characters. Consider the following HTTP request: POST http://api.ecs.eu/feedback Content-Type: application/json { "id": {{$randomInt 9 1000000}}, "feedback": "🫠", "date": "{{$datetime iso8601}}" } Notice, that the content-type is set to application/json without a specific encoding, and the feedback property contains an emoji. Most likely, th...| Waldek Mastykarz
Here's how you can use Prompty with Foundry Local| Waldek Mastykarz
Azure AI Search gives M365 Copilot agents balanced control over knowledge without custom agent complexity. The smart middle ground for RAG you're overlooking.| Waldek Mastykarz
Here's an easy way to calculate the number of language model tokens for a string.| Waldek Mastykarz
If you want to create an npm package and ensure it can be used by everyone, you'll want it to support CommonJS (CJS) and ECMAScript Modules (ESM). Here's how to build such a package using TypeScript. CommonJS and ESM When building JavaScript apps, you have two module systems to choose from: CommonJS and ECMAScript Modules. Despite the recent rise of ESM, CommonJS is still widely used, and not to mention default in Node.js. To make sure your npm package can be used by everyone, you'll want to ...| Waldek Mastykarz
APIs are crucial for app integration with cloud services, but debugging API requests can be challenging. Here's a trick to quickly trace the location of each API request in your code.| Waldek Mastykarz
When building apps for macOS, you might want to add a background color to your icon in the menu bar. This is a great way to make your app stand out and make it easier for users to find your app in the menu bar. To add a background color to your icon in the menu bar, the trick is to find the right view to apply the background color to. Here's how you can do it in Swift. Start, by getting a reference to the status item. Then, get the status item's button. Configure the image to fit the button. ...| Waldek Mastykarz
Use ProxyStat to easily see if you have system proxy configured on macOS| Waldek Mastykarz