• bassomitron@lemmy.world
    link
    fedilink
    English
    arrow-up
    1
    ·
    edit-2
    2 hours ago

    Does flash, like solid state drives, have the same lifespan in terms of write? If so, it feels like this would most certainly not be useful for AI, as that use case would involve doing billions/trillions of writes in a very short span of time.

    Edit: It looks like they do: https://www.enterprisestorageforum.com/hardware/life-expectancy-of-a-drive/

    Manufacturers say to expect flash drives to last about 10 years based on average use. But life expectancy can be cut short by defects in the manufacturing process, the quality of the materials used, and how the drive connects to the device, leading to wide variations. Depending on the manufacturing quality, flash memory can withstand between 10,000 and a million [program/erase] cycles.

    • schema@lemmy.world
      link
      fedilink
      English
      arrow-up
      2
      ·
      edit-2
      2 hours ago

      For AI processing, I don’t think it would make much difference if it lasted longer. I could be wrong, but afaik, running the actual transformer for AI is done in VRAM, and staging and preprocessing is done in RAM. Anything else wouldn’t really make sense speed and bandwidth wise.

      • bassomitron@lemmy.world
        link
        fedilink
        English
        arrow-up
        1
        ·
        47 minutes ago

        Oh I agree, but the speeds in the article are much faster than any current volatile memory. So it could theoretically be used to vastly expand memory availability for accelerators/TPUs/etc for their onboard memory.

        I guess if they can replicate these speeds in volatile memory and increase the buses to handle it, then they’d be really onto something here for numerous use cases.

  • Phoenixz@lemmy.ca
    link
    fedilink
    English
    arrow-up
    12
    ·
    6 hours ago

    Clickbait article with some half truths. A discovery was made, it has little to do with Ai and real world applications will be much, MUCH more limited than what’s being talked about here, and will also likely still take years to come out

    • 𝓔𝓶𝓶𝓲𝓮@lemm.ee
      link
      fedilink
      English
      arrow-up
      1
      arrow-down
      2
      ·
      edit-2
      2 hours ago

      The key word is China, let us not kid ourselves. Otherwise it would be just another pop sci click but now it can be an ammunition in the fight with imperialist degenerated west or some bs like that

  • CouncilOfFriends@slrpnk.net
    link
    fedilink
    English
    arrow-up
    149
    arrow-down
    1
    ·
    10 hours ago

    By tuning the “Gaussian length” of the channel, the team achieved two‑dimensional super‑injection, which is an effectively limitless charge surge into the storage layer that bypasses the classical injection bottleneck.

  • boonhet@lemm.ee
    link
    fedilink
    English
    arrow-up
    65
    arrow-down
    9
    ·
    edit-2
    10 hours ago

    AI AI AI AI

    Yawn

    Wake me up if they figure out how to make this cheap enough to put in a normal person’s server.

    • Zip2@feddit.uk
      link
      fedilink
      English
      arrow-up
      87
      arrow-down
      11
      ·
      10 hours ago

      normal person’s server.

      I’m pretty sure I speak for the majority of normal people, but we don’t have servers.

      • Rose@slrpnk.net
        link
        fedilink
        English
        arrow-up
        29
        ·
        7 hours ago

        Yeah, when you’re a technology enthusiast, it’s easy to forget that your average user doesn’t have a home server - perhaps they just have a NAS or two.

        (Kidding aside, I wish more people had NAS boxes. It’s pretty disheartening to help someone find old media and they show a giant box of USB sticks and hard drives. In a good day. I do have a USB floppy drive and a DVD drive just in case.)

        • KnightontheSun@lemmy.world
          link
          fedilink
          English
          arrow-up
          8
          ·
          7 hours ago

          Hello fellow home labber! I have a home built xpenology box, proxmox server with a dozen vm’s, a hackentosh, and a workstation with 44 cores running linux. Oh, and a usb floppy drive. We are out here.

          I also like long walks in Oblivion.

          • MrPistachios@lemmy.today
            link
            fedilink
            English
            arrow-up
            4
            ·
            6 hours ago

            Man oblivion walks are the best until a crazy woman comes at you trying to steal your soul with a fancy sword

        • pivot_root@lemmy.world
          link
          fedilink
          English
          arrow-up
          2
          ·
          5 hours ago

          It’s pretty disheartening to help someone find old media and they show a giant box of USB sticks and hard drives.

          Equally disheartening is knowing that both of those have a shelf-life. Old USB flash drives are more durable than the TLC/QLC cells we use today, but 15 years sitting unpowered in a box doesn’t have very good prospects.

      • notabot@lemm.ee
        link
        fedilink
        English
        arrow-up
        12
        ·
        9 hours ago

        You… you don’t? Surely there’s some mistake, have you checked down the back of your cupboard? Sometimes they fall down there. Where else do you keep your internet?

        Appologies, I’m tired and that made more sense in my head.

    • gravitas_deficiency@sh.itjust.works
      link
      fedilink
      English
      arrow-up
      4
      arrow-down
      1
      ·
      5 hours ago

      You can get a Coral TPU for 40 bucks or so.

      You can get an AMD APU with a NN-inference-optimized tile for under 200.

      Training can be done with any relatively modern GPU, with varying efficiency and capacity depending on how much you want to spend.

      What price point are you trying to hit?

      • boonhet@lemm.ee
        link
        fedilink
        English
        arrow-up
        3
        ·
        4 hours ago

        What price point are you trying to hit?

        With regards to AI?. None tbh.

        With this super fast storage I have other cool ideas but I don’t think I can get enough bandwidth to saturate it.

        • barsoap@lemm.ee
          link
          fedilink
          English
          arrow-up
          1
          ·
          2 hours ago

          With regards to AI?. None tbh.

          TBH, that might be enough. Stuff like SDXL runs on 4G cards (the trick is using ComfyUI, like 5-10s/it), smaller LLMs reportedly too (haven’t tried, not interested). And the reason I’m eyeing a 9070 XT isn’t AI it’s finally upgrading my GPU, still would be a massive fucking boost for AI workloads.

        • gravitas_deficiency@sh.itjust.works
          link
          fedilink
          English
          arrow-up
          1
          ·
          4 hours ago

          You’re willing to pay $none to have hardware ML support for local training and inference?

          Well, I’ll just say that you’re gonna get what you pay for.

          • bassomitron@lemmy.world
            link
            fedilink
            English
            arrow-up
            1
            ·
            2 hours ago

            No, I think they’re saying they’re not interested in ML/AI. They want this super fast memory available for regular servers for other use cases.

      • errer@lemmy.world
        link
        fedilink
        English
        arrow-up
        8
        ·
        7 hours ago

        “These chips are 10,000 times faster, therefore we will increase our tariffs to 10,100%!”

  • AItoothbrush@lemmy.zip
    link
    fedilink
    English
    arrow-up
    24
    arrow-down
    3
    ·
    edit-2
    9 hours ago

    Brother, have you heard of buses? Even INSIDE cpus/socs bus speeds are a limitation. Also i fucking hate how the first thing people mention now is how ai could benefit from a jump in computing power.

    Edit: I havent dabbled that much in high speed stuff yet but isnt the picosecond range so fast that the capacitance of simple traces and connectors between chips influence the rising and falling edge of chips?

  • tetris11@lemmy.ml
    link
    fedilink
    English
    arrow-up
    10
    arrow-down
    1
    ·
    10 hours ago

    Wow, finally graphene has been cracked. Exciting times for portable low-energy computing

    • CosmoNova@lemmy.world
      link
      fedilink
      English
      arrow-up
      24
      arrow-down
      2
      ·
      edit-2
      8 hours ago

      It‘s likely BS anyway. Maybe it’s just me but reading about another crazy breakthrough from China every single day during this trade war smells fishy. Because I‘ve seen the exact same propaganda strategy during the pandemic when relations between China and the rest of the world weren‘t exactly the best. A lot of those headlines coming from there are just claims about flashy topics with very little substance or second guessing. And the papers releasing the stories aren‘t exactly the most renowned either.

      • LadyAutumn@lemmy.blahaj.zone
        link
        fedilink
        English
        arrow-up
        3
        arrow-down
        2
        ·
        7 hours ago

        It’s definitely possible they’re amplifying these developments to maintain confidence in the Chinese market, but I doubt they’re outright lying about the discoveries. I think it’s also likely that some of what they’ve been talking about has been in development for a while and that China is choosing now to make big reveals about them.

    • jj4211@lemmy.world
      link
      fedilink
      English
      arrow-up
      10
      ·
      9 hours ago

      Note that this in theory speaks to performance of a non volatile memory. It does not speak to cost.

      We already have a faster than NAND non volatile storage in phase change memory . It failed due to expense.

      If this thing is significantly more expensive even than RAM, then it may fail even if it is everything it says it is. If it is at least as cheap as ram, it’ll be huge since it is faster than RAM and non volatile.

      Swap is indicated by cost, not by non volatile characteristics.

    • Viri4thus@feddit.org
      link
      fedilink
      English
      arrow-up
      7
      arrow-down
      7
      ·
      10 hours ago

      Or they can do what they normally do, steal it and then sue to be considered the original invento/founder and then make a Hollywood film about how they invented it/found it.