Programming Leftovers

• A backup is only as good as ...

  Today, while looking at previously-logged data in preparation for consumption of future similar data, I discovered to my horror, that tinylog(8) truncates lines at what I first assumed was 1024 but actually is 1000 bytes.

• Multiple level filters in jq

  Here's another note-to-self on using jq to shape JSON representations of OData to match what's returned using system query options. Thsi time it's all filtering at two levels.

  In the Back to basics: OData - the Open Data Protocol - Part 3 - System query options live stream last Friday we looked at OData's system query options.

  There was a question at the end about whether it was possible to use the $filter system query option at multiple levels, in an $expand context. I wrote up the question, and a detailed answer (summary: yes) with an example here: Can $filter be applied at multiple levels in an expand?.

• 0024: HYTRADBOI postmortem, HYTWACFI?, preimp, emergent ventures, data and reality, merkle search trees, readyset, julia compilation times

  Now that all that HYTRADBOI craziness is over I'm focusing on preimp. The goal is to work towards the programming experience that I envisioned for imp, but hack it together in clojure to avoid getting bottlenecked forever on language design.

  So far I have a simple clojure notebook with coarse-grained incremental maintenance. There are data cells that can be mutated by other code, with the changes being persisted back into the cell. The notebook is backed by a simple crdt, so once I finish hooking it up to the server it will allow collaborative editing of code and data. Next step after that is rendering the output values as interactive widgets, and then adding bidirectional editing so that interacting with the widgets for derived views can push changes to upstream data.

• Parsing JSON faster with Intel AVX-512

  A few years ago, we released a really fast C++ JSON parser called simdjson. It is somewhat unique as a parser in the fact that it relies critically on SIMD instructions. On several metrics, it was and still is the fastest JSON parser though other interesting competitors have emerged.

  Initially, I had written a quick and dirty AVX-512 kernel for simdjson. We never merged it and after a time, I just deleted it. I then forgot about it.

• "GameShell" interactive game for learning Linux shell commands

  A new project has been released which seeks to teach people how to use a UNIX style shell… via a game-like experience.

• Best Books on Data Science with Python

  Best Books on Data Science with Python, In the subject of data science, Python is one of the most extensively used programming languages.

  Pandas, NumPy, scikit-learn, Matplotlib, and SciPy are just a few of the Python packages and libraries that are specifically suited for specific functions.

• AI Attempts Converting Python Code To C++

  [Alexander] created codex_py2cpp as a way of experimenting with Codex, an AI intended to translate natural language into code. [Alexander] had slightly different ideas, however, and created codex_py2cpp as a way to play with the idea of automagically converting Python into C++. It’s not really intended to create robust code conversions, but as far as experiments go, it’s pretty neat.

Security Leftovers

• How to Store an SSH Key on a Yubikey

• OpenIKED 7.1 released

  OpenIKED 7.1 was released on May 23rd, 2022.

• Track Down Ghosts In Your WiFi With The Pwnton Pack

  If there’s something weird in your Network Neighborhood, who you gonna call? If you want your WiFi troubles diagnosed in style, try calling [Travis Kaun] — he might just show up wearing the amazing Pwnton Pack. Built from a replica Proton Pack similar to those used in the 1984 classic Ghostbusters, it’s a portable wireless security diagnostics kit that should be able to pinpoint any weaknesses in your wireless network.

PulseAudio 16 Released with Bluetooth Improvements, Opus Support in RTP Modules

GNU/Linux distro users still using PulseAudio would be happy to learn that PulseAudio 16 is here with battery level reporting for Bluetooth devices to other software, stereo output support for the EPOS/Sennheiser GSP 670 wireless gaming headset and SteelSeries GameDAC Hi-Res sound card DAC (Digital Audio Converter), as well as profiles for the Native Instruments Komplete Audio 6 MKII premium 6-channel audio interface.

PulseAudio 16.0

The audio sent with module-rtp-send can now be compressed with the Opus codec. To use it, pass enable_opus=true as a module argument to module-rtp-send. This feature works only when PulseAudio is compiled with GStreamer enabled (both sending and receiving end).