Merge lp://staging/~mbp/bzr/remove-pylzma into lp://staging/bzr

Proposed by Martin Pool
Status: Merged
Approved by: Martin Pool
Approved revision: no longer in the source branch.
Merged at revision: 6277
Proposed branch: lp://staging/~mbp/bzr/remove-pylzma
Merge into: lp://staging/bzr
Diff against target: 83 lines (+2/-25)
2 files modified
bzrlib/groupcompress.py (+2/-23)
bzrlib/tests/blackbox/test_export.py (+0/-2)
To merge this branch: bzr merge lp://staging/~mbp/bzr/remove-pylzma
Reviewer Review Type Date Requested Status
Vincent Ladeuil Needs Information
John A Meinel Approve
Review via email: mp+82097@code.staging.launchpad.net

Commit message

remove dead code for lzma compression

Description of the change

During the early development of the 2a format I think John tried out using pylzma, but it's never actually shipped turned on. This pulls out the conditional code:

 * It's not packaged in Ubuntu
 * We didn't use it in this format
 * The import possibly causes us to do io and possibly upsets dependency-inferring systems

https://lists.ubuntu.com/archives/bazaar/2009q2/057499.html

To post a comment you must log in.
Revision history for this message
Martin Pool (mbp) wrote :

sent to pqm by email

Revision history for this message
John A Meinel (jameinel) wrote :

Re-adding my comment, because lp rejected my non-signed email:
 merge: approve

There were some interesting benefits from it, but since it isn't officially part of the 2a format, we certainly don't want to accidentally use it.

Specifically:

1) lzma was very slow (~10x slower than zlib) when the data was not well delta-packed to start with (eg, initial commit, lots of fulltexts, etc). It did generate smaller content.
2) lzma was only a little bit slower and a little bit smaller when the data had good delta-compression ('bzr pack' time). IIRC, 30% smaller for ~30% more overhead.
3) lzma was a little bit slower to extract.
4) lzma bindings weren't trivial to get, though with xz being more standard now, that might be easier.
5) I didn't do memory profiling for lzma vs zlib. My guess it would be a fair amount worse for compression, a little bit worse for extraction.

In the end, lzma made a lot of sense for old data that isn't accessed much, and would already have a pretty good delta-compression chain. Which would be really nice for archived content.

We can certainly put it in the 'interesting, but not yet worth it' pile.

John
=:->

review: Approve
Revision history for this message
Vincent Ladeuil (vila) wrote :

26 elif self._compressor_name == 'lzma':
27 # We don't do partial lzma decomp yet
28 + import pylzma
29 self._content = pylzma.decompress(z_content)

Did you plan to remove this chunk and forgot ?

review: Needs Information
Revision history for this message
Vincent Ladeuil (vila) wrote :

Bah, sorry for the noise, got confused by the cover letter but the commit message is clear.

Revision history for this message
Jelmer Vernooij (jelmer) wrote :

sent to pqm by email

Revision history for this message
Jelmer Vernooij (jelmer) wrote :

sent to pqm by email

Revision history for this message
Jelmer Vernooij (jelmer) wrote :

sent to pqm by email

Revision history for this message
Jelmer Vernooij (jelmer) wrote :

I keep wondering why I'm not getting the PQM failure emails for this. Are they sent to Martin only ?

Revision history for this message
Martin Pool (mbp) wrote :

I am not getting any failure mails. I will send it now.

Revision history for this message
Martin Pool (mbp) wrote :

sent to pqm by email

Revision history for this message
John A Meinel (jameinel) wrote :

pylzma refuses to die. Mwuahahahahahahahahaaaaa!

John
=:->
On Nov 16, 2011 1:40 AM, "Martin Pool" <email address hidden> wrote:

> I am not getting any failure mails. I will send it now.
>
> --
> https://code.launchpad.net/~mbp/bzr/remove-pylzma/+merge/82097
> You are reviewing the proposed merge of lp:~mbp/bzr/remove-pylzma into
> lp:bzr.
>

Revision history for this message
Jelmer Vernooij (jelmer) wrote :

sent to pqm by email

Revision history for this message
Martin Pool (mbp) wrote :

something is wrong, apparently specific to this branch. I will look into it
tomorrow.
On Nov 17, 2011 8:53 PM, "Jelmer Vernooij" <email address hidden> wrote:

> sent to pqm by email
>
> --
> https://code.launchpad.net/~mbp/bzr/remove-pylzma/+merge/82097
> You are the owner of lp:~mbp/bzr/remove-pylzma.
>
>

Revision history for this message
Jelmer Vernooij (jelmer) wrote :

So John was right, this branch *is* haunted. I will stop submitting it
to PQM then :-)

Cheers,

Jelmer

Am Thu 17 Nov 2011 12:02:51 CET schrieb Martin Pool:
> something is wrong, apparently specific to this branch. I will look into it
> tomorrow.
> On Nov 17, 2011 8:53 PM, "Jelmer Vernooij" <email address hidden> wrote:
>
>> sent to pqm by email
>>
>> --
>> https://code.launchpad.net/~mbp/bzr/remove-pylzma/+merge/82097
>> You are the owner of lp:~mbp/bzr/remove-pylzma.
>>
>>
>

Revision history for this message
Martin Pool (mbp) wrote :

sent to pqm by email

Preview Diff

[H/L] Next/Prev Comment, [J/K] Next/Prev File, [N/P] Next/Prev Hunk
The diff is not available at this time. You can reload the page or download it.