Arun Shah™@lemmy.world to Technology@lemmy.ml · 21 hours agoTop 10 website in the world ( July 2025 )lemmy.mlexternal-linkmessage-square25fedilinkarrow-up181arrow-down18
arrow-up173arrow-down1external-linkTop 10 website in the world ( July 2025 )lemmy.mlArun Shah™@lemmy.world to Technology@lemmy.ml · 21 hours agomessage-square25fedilink
minus-squarePechente@feddit.orglinkfedilinkarrow-up1·20 hours agoMy comment was based on a podcast I listened to (Tech won’t save us, I think?). My guess is they also wanna crawl all the edits, discussion etc. which is usually not included in the complete dumps.
minus-squareclb92@feddit.dklinkfedilinkarrow-up2·4 hours agoDumps with complete page edit history can be downloaded too, as far as I can see, so no need to crawl that.
My comment was based on a podcast I listened to (Tech won’t save us, I think?). My guess is they also wanna crawl all the edits, discussion etc. which is usually not included in the complete dumps.
Dumps with complete page edit history can be downloaded too, as far as I can see, so no need to crawl that.
Good pod cast