Download raw body.
Poor fetching from gotd
On Sun, Feb 26, 2023 at 08:13:16PM +0100, Christian Weisgerber wrote: > Christian Weisgerber: > > > Fetching performs poorly. It is very slow and appears to always > > download at least ~3 MB of data. > > $ cd got.git/objects/pack > $ ls -lrt *.pack | tail -5 > -rw-r--r-- 1 naddy naddy 427612 Feb 6 16:25 pack-e2fdbbeab037003a8c7f9c2d6fba537b654bf820.pack > -rw-r--r-- 1 naddy naddy 495086 Feb 22 23:49 pack-b8bcfda4d9210d5f36ec7d6afa09ddb7c7e39226.pack > -rw-r--r-- 1 naddy naddy 3203102 Feb 23 19:03 pack-58058359ebaf239fa80ccf02737a1c0430ccb6b9.pack > -rw-r--r-- 1 naddy naddy 3230094 Feb 25 17:04 pack-d53d7b1a2932b4f0d7e9b5d33197ef09abc5f2a8.pack > -rw-r--r-- 1 naddy naddy 3234283 Feb 26 16:10 pack-e568a08d8cc5a396b3e1cb52c9109acaf9ca4026.pack > > I think those last three packs are the fetches since I switched to > got.gameoftrees.org. > > $ gotadmin ls pack-e568a08d8cc5a396b3e1cb52c9109acaf9ca4026.pack | wc > 5627 41832 482462 > > Well, that's a lot. > > Comparing only the first field, the hash, from gotadmin ls's output > shows that the packs are largely redundant: > > 47 new hashes from pack-5805835 to pack-d53d7b1. > 5 new hashes from pack-d53d7b1 to pack-e568a08. > > The thousands of other hashes are the same. So got(1) now appears > to be downloading the same stuff over and over again. That doesn't > seem right. Hmm, that is indeed strange and should not be happening. I tried the following but did not yet manage to reproduce the issue: got clone -m ssh://anonymous@got.gameoftrees.org/got.git Rewind the main branch by one commit: - Note the hash of the parent commit of the tip commit of the main branch. - Delete the reference 'refs/heads/main', then re-create it pointing at the parent commit noted previously. Then fetched with 'got fetch'. Which only fetched about 35k, and 8 objects in total: -rw-r--r-- 1 stsp wheel 821696 Feb 26 23:03 objects/pack/pack-d8fb01fc812ff5174fea122444f1b4c82f1a7982.idx -rw-r--r-- 1 stsp wheel 8262963 Feb 26 23:02 objects/pack/pack-d8fb01fc812ff5174fea122444f1b4c82f1a7982.pack -rw-r--r-- 1 stsp wheel 1296 Feb 26 23:03 objects/pack/pack-e9bb92cf0e1a0b13b945c01cf2100ecbcc73cde4.idx -rw-r--r-- 1 stsp wheel 34508 Feb 26 23:03 objects/pack/pack-e9bb92cf0e1a0b13b945c01cf2100ecbcc73cde4.pack $ gotadmin ls objects/pack/pack-e9bb92cf0e1a0b13b945c01cf2100ecbcc73cde4.pack | wc -l 8
Poor fetching from gotd