pier25

I've suspected for years that AI companies have been using commercial software to train their models including games, audio plugings, DAWs, etc. It would not surprise me one bit if we find out they used torrented pirated apps like they did with books and music.

There's certainly eg open source audio dev material out there but not nearly as much as web dev. How else do you explain all the avalanche of vibe coded audio plugins and DAWs appearing this year?

show comments
rossy

Like the weight space stuff, I think there's a small misdirection in how this is presented: Phrases like "write directly in machine code" seem to imply that ordinary LLMs intuitively understand machine code as just another language, like English or JavaScript, that they read from context and write directly as tokens, and that this intuitive understanding could mean increased efficiency or capabilities if you ask the LLM to just use the bytes rather than asking it to use the tools that human reverse engineers use.

If that's what you assumed, the DeepSeek reasoning trace shatters that illusion. It's just disassembling by hand like what a human reverse engineer would do if you (sadistically?) denied them a disassembler. Yeah, the human reverse engineer would need an excellent memory of the x86_64 instruction reference, but we already know LLMs can recall a breadth of information. What we don't know, that this article also provides no evidence for, is if there will be any benefit in using the LLM for this over objdump.

The article seems to intentionally conflate disassembly (computationally cheap) with decompilation (can be computationally expensive) to imply that there's some benefit to asking the LLM to work with machine code (seems impressive to the RE layman) rather than working in assembly (something you probably already assumed LLMs can do,) but the DeepSeek trace has a disassembly in it, and it's hard to imagine that inference will ever be cheaper or more reliable per-token than objdump is at producing the same output.

show comments
bita_nidir

I don't think it'll make sense for an LLM to program directly on the cpu opcode level due to the overhead.

But I hope you all realize that the programming language of the future is going to be for LLMs. It'll tightly optimized for LLMs and we'll get nice tools to understand them. They'll probably be great, with loads of fancy tooling.

show comments
MomsAVoxell

Back in the day, thats how we got executables from one system to another, over ASCII-tuned serial lines. I had a colleague in the 80’s who could muscle-memory a “hx.c” which would produce the requisite hex listing given an input, and if that input was a hex listing, reproduce the binary. It was something like 12 lines of C code and it saved our asses so many times, he eventually made a DOS compatible equivalent that could be piped into DEBUG.com to produce the same results.

show comments
mfuzzey

This can be useful in the reverse engineer / malware analysis case where there is existing machine code and no source but I don't think that AI "writing machine code directly rather than high level languages" makes sense. Code generation by LLMs is a non deterministic process so it makes far more sense to generate higher level compilable source code once and then compile it with a deterministic compiler for each target rather than generate machine code non deterministically several times seperately for each target.

show comments
orbital-decay

Yeah sure, people have experimented with giving them binaries since the first instruction-tuned models. They do it poorly though, compilers and decompilers are still necessary.

show comments
jrmg

This has been true for some time now. I can't remember details, but about a year ago, I was debugging some boot issues on an AVR microcontroller, and just pasting the HEX of the bootloader (that I didn't have access to the source of) into Claude's web interface got me the answers I needed.

plastic3169

It feels like image models which create images and video by bitbanging pure pixels. This is almost never the way people would approach the task of creating images barring pixel graphics. It also means that using image models is inconvinient. I always likened it to having programming AI that would go from prompt to binary. I thought we don’t program like that because programmers understand the problem area better and like to go through source code.

show comments
JKCalhoun

An uninteresting case I am sure, but I have been leaning on LLMs to disassemble 6502 hex dumps and it's no doubt easy-lifting for them.

And the proof of course is that I can reassemble/link, with "modern" tools, their presented assembly and it combines right back into a hex dump mirroring the original.

Anyway, it's been a joy to take the long-out-of-print book, "The First Book of KIM", and re-typeset it (re-assemble it?) for modern hobbyists like myself. LLMs have allowed me to clean up the poor OCR-extracted text from the original. Claude has not only done that, but found missing labels and "equates" in the assembly, as legitimately printed in the book—not OCR errors.

Heck, Claude latched on to a bug in the classic "WUMPUS" game that apparently the author was not even aware of. (But I left that bug in for hobbyists to find—or exploit.)

nubinetwork

A hex dump is just extra bytes of ascii filling up context... having to deal with "20 e3 8f" is 8 characters of text, compared to 3 bytes. LLMs can already parse binary files without the text overhead.

itsquiteamazing

Funny I was doing this the other day. Write an HTTP server and some routes directly as a FreeBSD binary, no intermediaries, no tools. It works and you know what, I am not even surprised.

bitexploder

Yeeeeep. Been saying this for months. Go paste them Base 64…. Dozens of other formats. Use an open model. Watch thinking traces: “i am now mentally decoding X” O_o

Now think about homomorphism and safety filters……

Neywiny

Wow. It can read bytes from a byte output? That's incredible

show comments
pipes

I could be wrong, but this is really silly: 1. Read byte by byte, well yes, executables are files how else do you want them to read and write them.

2. Binaries are 1 to 1 direct representations of the assembly code they are created from. If you know the instructions set it isn't black magic to figure what byte means what.

Why on earth would it be better for llms to program in binary or assembly. We have optimizing compilers so the effort doesn't need to be spent there.

Maybe my assumptions are wrong, so please correct me.

Edit: but yes, in general it's utterly amazing I can ask computer to tell what a computer program does, even a binary file.

Buttons840

I wonder if you trained a LLM on the data that has passed through my router throughout my whole life how smart it would be.

I mean decrypted data of course, because it surely couldn't learn directly from encrypted data, right? Right?

andai

Couldn't they do this before?

They don't list any model size or version that failed, right?

layer8

I wonder if prompt injection via an executable is possible. Especially in the context of having AI perform malware analysis.

show comments
flohofwoe

Hmm, is this new or surprising? When testing my home computer emulator code for correctness, Opus had no trouble taking C64 .prg files apart and analyse them the same way it would analyse .asm source files.

PS: and it also has no problem writing a simple 'bouncing sprite' C64 demo without going through assembly and wrap that in a .prg file (of course this is basically the 'hello world' of C64 demos and could be as-is in the training set).

Let's see if the data URL survives HN:

https://floooh.github.io/tiny8bit/c64.html?file=data%3Aappli...

secondcoming

I recently watched a video of a guy trying to unbrick his Harley Davidson Livewire electric motorbike. Harley Davidson were unable to do it. Perplexity created an app to sniff the canbus and talk to the battery and other components on the bike. Soon it'll be possible to write your own firmware for things like this.

[0] is the episode I'm referring to, but the whole series of videos about his woes with this bike are quite interesting.

[0] https://www.youtube.com/watch?v=Z4Ty0oqA_Bk

tliltocatl

So can I. CD 20

dreamcompiler

Since disassembly is a solved problem and it's deterministic with a 1:1 solution, why throw a nondeterministic LLM at it? Why not give the disassembly output to the LLM and let it do the decompilation, which is not 1:1?

Pet peeve: Using AI to solve problems that existing algorithms can dependably solve with 10^-6 the CPU resources.

show comments