Joey short
untitled

Taking a break after 1.5 weeks of travel, city life, hard work, camping, and kayacking

Posted
Joey short
untitled

I guess that most git-lfs users are ones who are ok with cloning a repo downloading all the files in it, and most git-annex users want to avoid that a lot of the time and only access the subset of files they need.

So it would make sense that git-annex repos just tend to be a lot bigger than git-lfs repos, on average.

Posted
Joey short
untitled

By volume that is... I think git-lfs probably has more users, based on eg debian popcon.

Posted
Joey short
untitled

This is an apples to oranges comparison though in a lot of ways. Source code + issues + artifacts vs raw and processed data.

What I was really interested in is which of git-annex and git-lfs stores more data.

If we assume that less than half of Github is git-lfs, which seems reasonable, and also assume that Gitlab is about as big, and assume that most git-lfs data is stored on those two... Well, that's a lot of assumptions, but it seems likely that git-annex >= git-lfs

Posted
Joey short
untitled

what's really wild though is that yeah, this is a lot of data, on the order of 60 million filing cabinets full of text... but it's also just a few hundred modern hard drives

Posted
Joey short
untitled

Been summing up reports about the sizes of all the scientific data stored using and it at least 3-5 petabytes, and growing by at least 2 petabytes per year currently.

In 2022, Github consisted of ~4 petabytes of data (excluding replicated data).

This is also in the neighborhood of the total size of the Library of Congress's digital collections, which was 3 petabytes in 2012.

Dunno who will win this race, but I'm surprised to be in it. ;-)

Posted
Joey short
untitled

Worked from 4 am to 7 and now gotta drive for 6 hrs. Gaaaaah

Posted
Joey short
untitled

also "ummm\\git~1" yes, it actually looks for windoes backslashes on linux

wish I were making this up

Posted
Joey short
untitled

now considers a symlink to "git~1" something git fsck should warn about, on Linux, because on Windows, that happens to be a way to refer to the .git directory.

rotfl

joey@darkstar:~/tmp/foo>ln -s git~1 foo
joey@darkstar:~/tmp/foo>git add foo
...
joey@darkstar:~/tmp/foo>git fsck
Checking object directories: 100% (256/256), done.
warning in blob 086654741cca64b19ba88286fce998d933897870: symlinkPointsToGitDir: symlink target points to git dir

Posted
Joey short
untitled

I've hacked panorama-view to display a scrolling overview of open tabs.
It really does make cleaning up a large number of open tabs, reordering tabs etc much easier.

Pondering releasing this as a new firefox extension, though I'd have to do significant cleanup of my hacking.

Posted
Joey short
untitled

question: Do either or have a way to display open tabs in a grid as mini windows?

On desktop that is... on mobile all web browsersdo it automatically! As shown in this screenshots of firefox.

FWIW I'm asking because I've been told this interface is very useful for someone with ADHD to keep on top of their tabalanche.

Posted
Joey short
untitled

Left camp. Kayacking photos later.. Flipped mine yesterday under a waterfall

Posted
Joey short
untitled

Working on a design for an inexpensive ground mount array.

Brightmount EG4 is favored for low cost, I'd need 8 of them for 32 panels. With concrete, that comes to $3288.

Ironridge is champaign quality and price... approx $5000.

But... I have an idea for Ironridge on a pressure treated wood frame, which will cost just $2088!

Turns out GM-BRC3-01-M1 will perfectly fit a 4x4 post (3.5" actual), since the 3" pipe it's designed for is also 3.5" actual. Just round off the corners..

Posted
git-annex devblog (Joey devblog)
day 652-664 git-remote-annex

The Distribits conference was a wonderful chance to meet with many scientific users of git-annex and learn about amazing things they are doing with it.

After giving my talk, titled "git annex is complete, right?", it turned out (spoilers) to not be complete. Indeed, the very next talk gave me a big idea that I have been working on for the past several weeks and have merged into master today. Michael Hanke described his git-remote-datalad-annex which lets git push, pull, and even clone from a git-annex special remote.

I immediately saw that this would be better implemented in git-annex, which would let it use its internals rather than some of the hacky workarounds Michael needed. Also, I saw that git bundles were a much better data format to use, which would allow cheap incremental git pushes.

At the Distribits hackathon, I got together with Michael and Timothy Sanders, and we thought through the data format to store on special remotes. We ended up with a quite simple data design, which can be used without git-annex if necessary. (See git-remote-annex.)

Getting git bundles to work right, especially incremental bundles, and dealing with all the quirks of git's gitremote-helper interface turned out to be more challanging than I thought. I ended up spending a week implementing a prototype in shell script to work through all the details. Then I had to reimplement it all in Haskell, ending up with over 1000 lines of code.

The result is the git-remote-annex, which will ship in the next git-annex release. It should work with most types of special remotes, including exporttree=yes ones (but not yet importtree=yes). But I've only tested it on the directory special remote so far. It's really neat to be able to git clone a repository from so many places, as well as incrementally push changes.

There is a git-remote-annex todo page, of which a lot of the remainder is various race conditions when two people are pushing different things to the same special remote at the same time. At least some of those will be dealt with, for now I recommend only using git-remote-annex when you know you're the only one pushing to a special remote.

This work was sponsored by Mark Reidenbach, Jake Vosloo, Lawrence Brogan, Graham Spencer, unqueued, and Erik Bjäreholt on Patreon

Posted
Joey short
untitled

This rainy week has been challenging for baking, it takes 25% of my battery to bake a loaf, but I've managed to make 2. This one ran the battery down to 9%.

Posted
Joey short
untitled

ah, switched opencamera to camera2 api and now I have noise reduction, low light, ISO, exposure settings so can finally take half-decent night time photos.. too late for the aurora.

Posted
Joey short
untitled

My phone is hopeless in the dark, I did see it a bit on another skygazer's there.

Posted
Joey short
untitled

Long time ago, I remember my dad setting off in the dusk, driving north out of Tennessee to Virginia on country roads, toward the mountain, intently looking North to the horizon in hopes of catching an this far south. I don't think he saw it.

Just back from my own drive (to the same mountain range), where I saw ... a hint of pinkness to the sky. A faint vertical line. One or twice, a flicker of movement.

Not enough, but something. Tempted to drive to Dayton tomorrow.. looking North.

Posted
Joey short
untitled

train was amazing! my 1st one. With my hand at arm's length it just fit in betwen thumb and forefinger.

Posted
Joey short
untitled

waiting in the yard to catch starlink train, then driving to a mountain with a north view into Virginia for (low probability) aurora spotting

Posted
Joey short
untitled

sky train passing overhead at 9:30 here, looks perfect viewing opportunity if the clouds cooperate

also, if the solar storm does deorbit any, it will be those same just-launched ones

Posted
Joey short
untitled

internetting some good internet this evening.. it still exists

Posted
Joey short
untitled

after spending 3 days translating a shell script to haskell and integrating it into , it didn't work the 1st try

but it did work after a single bug fix!

Posted
Joey short
untitled

This raises an interesting question. If a GPDR request to delete personal data causes a removal of attribution required by a license, does that nuke the material too, despite it not being personal data itself

It's an appealing line of thought in the stackoverflow case, but not so much if I consider a GPDR request against say, Debian to remove all my contributions. I should not be able to retroactively destroy Debian.

Anyone have insight on the legalities?

mas.to/@osma/11241558576832485

Posted
Joey short
untitled

hammer destroys mind control screen -> mind control screen destroys all, the endless cycle

Posted
Joey short
untitled

On my second day of rewriting my prototype shell script in haskell

Posted
Joey short
untitled

learning about git merge-base

How is there another git command I've never even heard of lol.

Posted
Joey short
untitled

Here's a big site: 5 megawatts of solar (plans for 25, think 100 acres of panels), with 3 megawatts of batteries, to charge EVs and electric semi trucks (at 1.2 megawatts).

It's wild that this is (apparently) economical now. There are surely better arbitrage opportunities with a grid connection, to charge the batteries from the grid and sell back to the grid as well as selling EV fast charges.
But interconnection lag be damned, we need this now.

electrek.co/2024/05/06/wattev-

Posted
Joey short
untitled

This reminds me of when I rewrote all of debhelper from shell to perl in a couple days way back when.

Posted
Joey short
untitled

Last week I prototyped a git remote helper in a shell script, and now I'm rewriting that in as part of .

I don't do this often and I wonder if it was a mistake, probably I should have written the prototype in haskell and then integrated it into git-annex. It's kind of amazing how a lot of complexity is melting away and also how I'm adding So Many Types and also throwing in a lot of robustness improvements.

Posted
Joey short
untitled

Shout out to the scammers who have a fake SpaceX youtube stream of the Boeing launch. Deepfake Elon scamming for bitcoin and dodgecoin has 100,000 (apparent) viewers to NASA's 19,000.

Posted
Joey short
untitled

honorable mention to "In this image we can see a poster. On the poster we can see some text and a picture of a ship."

Posted
Joey short
untitled

in awe of some truely horrible image descriptions I've seen on here today

the best one of all consisted of: "image/jpeg"

Posted
Joey short
untitled

that my aunt's husband's father came up with the jingle "snap crackle pop, rice crispies"

Posted
Joey short
untitled

has made a statement about how they will prevent the Bell riots.

All hail our AI overlords.

Posted
Joey short
untitled

Thanks Amazon, I definitely wanted to quiz chatgpt on AI trick questions rather than search product reviews for actually useful information.

Posted
Joey short
untitled

got some solar powered path lights (motion sensing) a few years ago and most of them have died

I assumed it was dead batteries or failed solar panels.. but the panels are still working, the battery was at 1v but I recharged it to 3v and it works fine, can run the light.

The charge circuit is only producing 1v from 5v input for some reason. Interesting failure mode.

Posted
Joey short
untitled

just made a hard link to a symlink and... I'm never gonna find the bottom of unix am I?

lrwxrwxrwx 2 joey joey 12 May 3 11:18 y -> foo

Posted
Joey short
untitled

Early start to river swimming season.

Posted
Joey short
untitled

Last quote I got for fiber involved a laughing suggestion of a $20k installation fee..

Posted
Joey short
untitled

Applied for fiber from a coop that was founded to serve a county in the next state over, but has been expanding here for several years and now claims they can service my address.

(they haven't seen my 1 mile driveway yet..)

A nonprofit would be quite a leg up from starlink.. Not to mention symmetric 1gbps.

Posted
Joey short
untitled

Clearly this would be something for the git mailing list. Except I'm building a gitremote-helper that is targeting working with existing git. So I've already implemented a workaround. Thus motivation for repeatedly rebasing C patches over email is not large.

Posted
Joey short
untitled

why does when pushing to a remote helper, first "list" the remote, then send the helper a "push", and only *then* notice if there's a non-fast-forward and claim the push has failed?

This seems to mean every remote helper has to detect non-fast-forward pushes and reject them, redundantly to git's own detection of the same thing.

(See for example git-remote-gcrypt documenting this as "A longstanding bug is that every git push effectively has a --force.")

Posted
Joey short
untitled

I encourage making websites return jwz balls when HN retitles your stuff. I assume JWZ is ok with being a CDN for this purpose.

Posted
Joey short
untitled

Hacker news adds a question mark to "The man who killed google search" to make it more "accurate" despite not having read it (or even AI summarized it I guess?)

Meanwhile, Metafilter shows me again why I love it despite itself.

Posted
Joey short
untitled

The reverse engineering of the JS they're doing is particularly amusing. Like, it contains 679 embedded javascript libraries and all of their licenses, and 1 mb of every load is used to send those licenses over the wire.

Posted
Joey short
untitled

It's been illuminating to watch 's web interface bit rot over the past couple of years. Until last month it rotted away entirely, with the device serving up only a logo.

Amusingly some users were able to restore the old web interface, which still works because the underlying data is still being provided (and will be probably since the phone app uses the same data source).
github.com/iam-TJ/open-dishy/

Now when I go to dishy.starlink.com, it's running on my raspberry pi.

Posted
Joey short
untitled

Voyager is a bit more V'ger from today

Posted
Joey short
untitled

Literally had to go find a blurb that was like "Die Hard meets The Martian--with a dash of Knives Out" to purge that previous blurb from my mind.

Posted
Joey short
untitled

"highly commericial" wtf?

Posted

List of feeds:

  • Anna and Mark: Waldeneffect: last checked (4610 posts)
  • Anna and Mark: Wetknee: last checked (42 posts)
  • Joey: last checked (224 posts)
  • Joey devblog: last checked (271 posts)
  • Joey short: last checked (963 posts)
  • Jay: last checked (50 posts)
  • Errol: last checked (53 posts)
  • Maggie: last checked (8 posts)
  • Tomoko: last checked (77 posts)
  • Jerry: last checked (28 posts)
  • Dani: last checked (23 posts)