This is just a fun experiment to answer the question: how can I share a memory-mapped tensor from PyTorch to Numpy, Jax and TensorFlow in The post Memory-mapped CPU tensor between Torch, Numpy, Jax and TensorFlow first appeared on Terra Incognita.| Terra Incognita
Copying data can be expensive in some cases, especially since it it doesn’t change the data, it’s just moves it. Therefore we, engineers interested in performance, want to avoid copying data as much as possible. We already talked about avoiding data copying in C++ earlier. In that post, we talked about what mechanism C++ has… Read The post Growing Buffers to Avoid Copying Data appeared first on Johnny's Software Lab.| Johnny's Software Lab
Recently, on my other blog accidentallyquadratic, I documented a case of accidentally quadratic behavior in /proc/$pid/maps on a wide range of recent Linux kernels. While this bug is amusing, it might initially not seem that important; /proc/$pid/maps is primarily a debugging or inspection tool, and while 30s access times aren’t pleasant, they probably aren’t breaking anything too critical. Today I want to explore, by way of some microbenchmarks, the more pernicious impact of that bug. I ...| nelhage debugs shit
Exploring how buffer pool management works in databases by building one| Bruno Calza
A saga through BoltDB source code to understand how mmap works in databases| Bruno Calza
Recently I've come to know the concept of memory-mapped files while watching a lecture of the course Intro to Database Systems of Andy Pavlo on database storage. One of the main problems a database storage engine has to solve is how to deal with data in disk that is bigger| Bruno Calza