For background, I am a programmer, but have largely ignored everything having to do with AI (re: LLMs) for the past few years.

I just got to wondering, though. Why are these LLMs generating high level programming language code instead skipping the middle man and spitting out raw 1s and 0s for x86 to execute?

Is it that they aren’t trained on this sort of thing? Is it for the human code reviewers to be able to make their own edits on top of the AI-generated code? Are there AIs doing this that I’m just not aware of?

I just feel like there might be some level of optimization that could be made by something that understands the code and the machine at this level.

  • naught101@lemmy.world
    link
    fedilink
    arrow-up
    5
    arrow-down
    6
    ·
    1 day ago

    Strong doubt that AI would be useful for producing improved compilers. That’s a task that would require extremely detailed understanding of logical edge cases of a given language to machine code translation. By definition, no content exists that can be useful for training in that context. AIs will certainly try to help, because they are people pleasing machines. But I can’t see them being actually useful.

      • naught101@lemmy.world
        link
        fedilink
        arrow-up
        1
        ·
        10 hours ago

        Yeah, as @uranibaba@lemmy.world says, I was using the narrow meaning of AI=ML (as the OP was). Certainly not surprised that other ML techniques have been used.

        That Cummins paper looks pretty interesting. I only skimmed the first page, but it looks like they’re using LLMs to estimate optimal compiler parameters? That’s pretty cool. But they also say something about it having a 91% hit compliant code hit rate, I wonder what’s happening in the other 9%. Noncompliance seems like a big problem? But I only have surface-level compiler knowledge, probably not enough to follow the whole paper properly…

      • uranibaba@lemmy.world
        link
        fedilink
        arrow-up
        2
        ·
        19 hours ago

        Looking at the tags, I only found one with the LLM tag, which I assume naught101 meant. I think people here tend to forget that there is more than one type of AI, and that they have been around for longer than ChatGPT 3.5.

    • Jack@slrpnk.net
      link
      fedilink
      arrow-up
      3
      ·
      1 day ago

      I agree but I would clarify that this is true for the current gen of LLMs. AI is much broader subject.