But inside the spacecraft's Linux-based flight software, a problem was brewing. Every 15 seconds, LightSail transmits a telemetry beacon packet. The software controlling the main system board writes corresponding information to a file called beacon.csv. If you’re not familiar with CSV files, you can think of them as simplified spreadsheets—in fact, most can be opened with Microsoft Excel.
And Julia is a big deal — it’s a free alternative to proprietary tools for doing data science, like MathWorks’ MATLAB and Wolfram’s Mathematica, and it’s more contemporary than open-source languages R and Python. More companies are hiring data scientists to make more data-driven decisions, and open-source tools often come in handy.
In October 2014, Databricks participated in the Sort Benchmark and set a new world record for sorting 100 terabytes (TB) of data, or 1 trillion 100-byte records. The team used Apache Spark on 207 EC2 virtual machines and sorted 100 TB of data in 23 minutes.
In comparison, the previous world record set by Hadoop MapReduce used 2100 machines in a private data center and took 72 minutes. This entry tied with a UCSD research team building high performance systems and we jointly set a new world record.
Ittia announced a design win for its lightweight embedded DB SQL database in Wasserbauer’s uClibc Linux based “Butler Gold” robot designed to feed cattle.
The Ittia DB SQL database and its antecedents, including .db*, have shipped in a wide variety of devices, including a circa 2005, Linux-based Oshkosh A3 HEMTT tactical truck. The lightweight, Linux- and Android-compatible embedded relational database has now found its way into barnyard life in its role within a Butler Gold cattle-feeding robot from Germany’s Wasserbauer GmbH. Linux has previously played a role in DeLaval’s Voluntary Milking System robot for cattle, but this is the first time we’ve seen it helping out on the other end.
It was a pretty long project. I didn’t work on it full time, obviously, but I probably worked on it over a period of six months, and most of the time was writing the software. A lot of the software was written in Python – like the controls for the webcam, the soundboard and everything – so most of the time was getting the software running and getting the kinks worked out. Like where if it loses a Wi-Fi connection it tries to rejoin and things like that. So, yeah, I definitely want to revisit it, and obviously the second time round you can do it a lot better than you did the first, so I’d like to go back.