Hey, I am curious, are people working on storing fediverse data off the servers? Like using bittorent protocol or ipfs?

  • RIotingPacifist@lemmy.world
    link
    fedilink
    English
    arrow-up
    1
    ·
    8 hours ago

    What do you mean by fediverse data?

    What problem are you trying to solve that isn’t solved by BitTorrent and IPFS?

    The nice thing about the fediverse is that it’s largely a concept with a few common protocols to make interoperability easier, you can solve pretty much any problem in line with the fediverse, but you do actually need a problem to solve.

  • squirrel@piefed.kobel.fyi
    link
    fedilink
    English
    arrow-up
    7
    ·
    21 hours ago

    PeerTube is using Webtorrent to distribute the load to all viewers that currently watch the video. And if you host a PeerTube instance you can manually mirror videos on your instance that are hosted on other PeerTube instances.

  • poVoq@slrpnk.net
    link
    fedilink
    English
    arrow-up
    10
    ·
    1 day ago

    Its is commonly done with S3 compatible storage, and projects like Garage allow to do so in a distributed way.

    Neither Bittorrent or IPFS seem particularly well suited for this.

    • Raphael@communick.news
      link
      fedilink
      English
      arrow-up
      3
      ·
      1 day ago

      projects like Garage allow to do so in a distributed way.

      Really? Does this mean that different instances could share a bucket? Do they have to trust each other? I’ll have to jump off the minio train anyway, if you have any tips to get this going would be nice.

      • poVoq@slrpnk.net
        link
        fedilink
        English
        arrow-up
        2
        ·
        22 hours ago

        Garage has deduplication of all files, yes. Obviously if you host something on server not under your control you have to have a certain trust in them. Generally speaking Garage seems to be a good replacement for Minio, but I don’t have any direct tips for migrating.

        There was also a project for Mastodon to sit between it and any S3 storage that would allow sharing and deduplicating files between instances, but I can’t find it right now and forgot the name. But it seemed stuck in a rewrite and not actively developed outside of that.

  • artyom@piefed.social
    link
    fedilink
    English
    arrow-up
    8
    ·
    24 hours ago

    Off of what servers? Fediverse data is already archived across thousands of servers through federation.