Show newer

Another major nit with Vizier 2.0 cleared. The table of contents artifact list now gives you per-artifact actions (e.g., scroll the workflow to the step that created the artifact). The issue tracker is still only at 41% completion, but it's actually more than usable at this point. I should set up a nightly build system.

Recent data exploration for work has also highlighted Vizier's main value proposition: Scala was pretty much the choice for building a ML pipeline, but I didn't think twice about tossing in a SQL cell for some ETL, or a Python cell for data vis in bokeh. It all just works seamlessly together.

Show thread

On a bit of a whim, I just added support for SparkML pipelines into Vizier's Scala cells (an easy 1-2 hr of effort). It ended up highlighting a lot of the value of building research software to existing standards for data science software. A few years back we completely rewrote Mimir ("todo notes" dataset annotations) for Spark Logical Plans. Now, without any extra effort or intent, Mimir annotations propagate through SparkML pipelines as well!

@elb It's pretty clear that it's got a solid-state storage medium... what is that, borosilicate?

@elb Seems like a situation where spinning rust would be a very bad idea.

I just came off a 24 hour hackathon at the local university. (I came home to crash for a few hours in the middle of the night, but many of the students didn't!) They're always such energizing events, with students doing tons of really interesting things and just being jazzed to learn.

I gave a talk about #retrocomputing computer-building projects. Slides are here:

(There are many omissions, and probably errors, it's a pitch more than a howto!)

In the interest of keeping Pepper&Carrot free, I've decided to take on subtle product placement.

we're reaching cyberpunk anime levels of infowarfare

Q: Why can't you write a web tool in JavaScript for digitizing data?

A: Many people have an A/D blocker installed.

@kyle Nice write-up! Out of curiosity, what's the magnetic dock you mention in the article?

⚠️ #Mastodon v3.4.6 is out! This patch release includes important security fixes.

And for those who are still on the 3.3.x branch, v3.3.2 is out with the same fixes.

@niconiconi It's been well over a decade since I last lost the game... not since 2005!!! Now I'm losing it nearly every day. Thanks.

Show older
X marks the spot

The social network of the future: No ads, no corporate surveillance, ethical design, and decentralization! Own your data with Mastodon!