Results 1 to 10 of 10

Thread: Fast update to latest version in a few megabytes?

  1. #1
    Junior Member registered user
    Join Date
    Apr 2003
    Posts
    13

    Fast update to latest version in a few megabytes?

    If Rsync is working at it's best, only the fragments of files which are different to your local copy are transmitted across the network connection. This means you can update from one version of Knoppix to the next without downloading the whole 700Mb.

    It is therefore possible to update your version of Knoppix from one version to the next by downloading only a few magabytes- just the pieces of the files which differ.

    The advantages of Rsync are not available when using Rsync to synchronise the whole Knoppix ISO. This is mainly because Knoppix uses a compressed file system. The compressed file system only needs to be changed slightly for all the data to change completely. - The byte offsets change causing the data in each compressed block to be different. Rsync cannot then determine the differences which need to be sent.

    Suggestion:
    The entire uncompressed, unpacked file system of the current Knoppix image should be made available via anonymous rsync. The user can run a special script to unpack the local copy of Knoppix, Rsync the local copy to the remote copy, then roll the updated version back into an ISO.

    This could probably be done with a simple Bash script taking care of all steps- creating a mount point, mounting the ISO, Unpacking the compressed FS, rsyncing the FS then packing the whole lot back into the latest ISO. If binaries from the Knopix ISO were used in the process, the resultant image should theoretically be identical such that an MD5SUM of the resultant ISO would match the latest Knoppix version.

    I do not have enough bandwidth here to offer a mirror of the current Knoppix distribution although I could do the scripting.


    Another approach would be to have a script and binary data representing the differences which could be patched against a version of Knoppix.

  2. #2
    Junior Member registered user
    Join Date
    Mar 2003
    Posts
    10
    Google for xdelta

  3. #3
    Member registered user
    Join Date
    Feb 2003
    Posts
    61

    great idea

    This is a good solution to a huge problem right now. Even though I have DSL at home, downloading an ISO every day is a bit much--especially for minor bug fixes. Such a scheme would require a lot of disk space, but might prove to make Knoppix even more useful.
    To expand on this, rather than have to download seperate ISOs for ClusterKnoppix and STD, they could just patch their versions and put up rSyncs too? [would that actually work?] Then all the various patches, and special needs could root back to 1 base distro!

  4. #4
    Junior Member registered user
    Join Date
    Apr 2003
    Posts
    13

    System now available

    I have written a patching system. Please see topics:

    http://www.knoppix.net/forum/viewtopic.php?t=3956
    http://www.knoppix.net/forum/viewtopic.php?t=3957

    The patch from 6/6/03 to 26/7/03 is 130Mb.

  5. #5
    Junior Member registered user
    Join Date
    Mar 2003
    Posts
    10
    Nah, Xdelta is the answer.

  6. #6
    Junior Member registered user
    Join Date
    Apr 2003
    Posts
    13
    Quote Originally Posted by beaky
    Nah, Xdelta is the answer.
    I have made an xdelta between the ISO of 6/6/03 and 26/7/03.

    The 27/6 ISO is 727525376 100%
    The xdelta file is 668205179 91.8%
    My patch file is 133789668 18.3%

    My patch file is much smaller. Xdelta alone is not the answer.

  7. #7
    Junior Member registered user
    Join Date
    Mar 2003
    Posts
    10
    Fair enough, you win although I'm amazed xdellta did so badly.

  8. #8
    Junior Member registered user
    Join Date
    Apr 2003
    Posts
    13
    Quote Originally Posted by beaky
    Fair enough, you win although I'm amazed xdellta did so badly.
    The filesystem is compressed. A fairly small change to the uncompressed file system will change the alignment of the data to the compressed blocks. Every compressed block will resultantly be different. The compressed representation of something slightly different tends to be substantially different. Consequently, there will be very few similarities for xdelta to take advantage of.

    My system uncompresses the filesystem, but leaves the structure untouched. The whole file system is chopped into manageable chunks. xdelta is then used to create a patch against those chunks.

    On reconstruction, each chunk is joined back together and re-compressed.

    My system will only work if the order of the files remain substantially the same and alignment is not moved by more than a few megabytes.

    I have made a proposal for xdelta. This involves creating a rolling window for the rolling checksum to allow large files to be diffed with small memory footprint. Xdelta does not currently work on most systems when the target files are gigabytes.

  9. #9
    Junior Member registered user
    Join Date
    Mar 2003
    Posts
    10
    Thinking about it I must have been dealing with uncompressed ISOs. Nice one though to feed the info back to xdelta. Good luck with that!

  10. #10
    Junior Member
    Join Date
    Aug 2003
    Posts
    1
    it would really be great for the people that burned it onto cd-rws could update the cd-rw...with a small file...i dont know if its possible though...

Similar Threads

  1. Replies: 2
    Last Post: 01-08-2004, 04:24 PM
  2. UPDATE/INSTALLING THE LATEST K3B TO BURN DVD-R/W
    By gonefishing in forum General Support
    Replies: 1
    Last Post: 01-01-2004, 08:57 PM
  3. Problem with WiFi and 3.3 11-03-2003 LATEST VERSION
    By andymadigan in forum Networking
    Replies: 0
    Last Post: 11-07-2003, 05:41 AM
  4. Latest Version Won't Detect HD Partitions
    By bongski55 in forum General Support
    Replies: 2
    Last Post: 09-10-2003, 03:35 AM
  5. How would I upgrade Gaim to the latest version?
    By reub2000 in forum Customising & Remastering
    Replies: 4
    Last Post: 06-04-2003, 07:06 AM

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •  


1U IBM x3550 M5 4 Bay SFF SAS3 Server 2x E5-2683 V3 28 Core 128GB DDR4 2x Tray picture

1U IBM x3550 M5 4 Bay SFF SAS3 Server 2x E5-2683 V3 28 Core 128GB DDR4 2x Tray

$318.00



IBM Power S822 8284-22A 12SFF Power8 3.89GHz 6Core 64GB RAM No HDD Server System picture

IBM Power S822 8284-22A 12SFF Power8 3.89GHz 6Core 64GB RAM No HDD Server System

$359.99



IBM Power S822 12-Bay Server System Power8 Core 3.42Ghz DVD-Rom Drive 64GB No HD picture

IBM Power S822 12-Bay Server System Power8 Core 3.42Ghz DVD-Rom Drive 64GB No HD

$399.99



IBM Server System X3100 M4 | Xeon @ 3.10 Ghz | 8GB | 250GB HDD No OS (IG-PC26) picture

IBM Server System X3100 M4 | Xeon @ 3.10 Ghz | 8GB | 250GB HDD No OS (IG-PC26)

$101.66



IBM System x3550 M3 Dual Intel Xeon X5650 @2.67GHz 32GB RAM No HDD picture

IBM System x3550 M3 Dual Intel Xeon X5650 @2.67GHz 32GB RAM No HDD

$84.50



ibm server z series picture

ibm server z series

$16000.00



IBM AC1 7870 BladeCenter Blade Server 2*Xeon X5570 2.93GHz 12GB SEE NOTES picture

IBM AC1 7870 BladeCenter Blade Server 2*Xeon X5570 2.93GHz 12GB SEE NOTES

$11.13



IBM SYSTEM x3200 M2 Server - HDD wiped, No OS picture

IBM SYSTEM x3200 M2 Server - HDD wiped, No OS

$75.00



IBM Lenovo X3650 M5 2U 8x 2.5” CTO Rack Server – 2x HS, 2x 750W picture

IBM Lenovo X3650 M5 2U 8x 2.5” CTO Rack Server – 2x HS, 2x 750W

$199.00



IBM Power S822 8284-22A 12SFF Power8 3.89GHz 6-Core 64GB RAM No Bezel/HDD Server picture

IBM Power S822 8284-22A 12SFF Power8 3.89GHz 6-Core 64GB RAM No Bezel/HDD Server

$319.99