-
Junior Member
registered user
Fast update to latest version in a few megabytes?
If Rsync is working at it's best, only the fragments of files which are different to your local copy are transmitted across the network connection. This means you can update from one version of Knoppix to the next without downloading the whole 700Mb.
It is therefore possible to update your version of Knoppix from one version to the next by downloading only a few magabytes- just the pieces of the files which differ.
The advantages of Rsync are not available when using Rsync to synchronise the whole Knoppix ISO. This is mainly because Knoppix uses a compressed file system. The compressed file system only needs to be changed slightly for all the data to change completely. - The byte offsets change causing the data in each compressed block to be different. Rsync cannot then determine the differences which need to be sent.
Suggestion:
The entire uncompressed, unpacked file system of the current Knoppix image should be made available via anonymous rsync. The user can run a special script to unpack the local copy of Knoppix, Rsync the local copy to the remote copy, then roll the updated version back into an ISO.
This could probably be done with a simple Bash script taking care of all steps- creating a mount point, mounting the ISO, Unpacking the compressed FS, rsyncing the FS then packing the whole lot back into the latest ISO. If binaries from the Knopix ISO were used in the process, the resultant image should theoretically be identical such that an MD5SUM of the resultant ISO would match the latest Knoppix version.
I do not have enough bandwidth here to offer a mirror of the current Knoppix distribution although I could do the scripting.
Another approach would be to have a script and binary data representing the differences which could be patched against a version of Knoppix.
-
Junior Member
registered user
-
great idea
This is a good solution to a huge problem right now. Even though I have DSL at home, downloading an ISO every day is a bit much--especially for minor bug fixes. Such a scheme would require a lot of disk space, but might prove to make Knoppix even more useful.
To expand on this, rather than have to download seperate ISOs for ClusterKnoppix and STD, they could just patch their versions and put up rSyncs too? [would that actually work?] Then all the various patches, and special needs could root back to 1 base distro!
-
Junior Member
registered user
-
Junior Member
registered user
Nah, Xdelta is the answer.
-
Junior Member
registered user
Originally Posted by
beaky
Nah, Xdelta is the answer.
I have made an xdelta between the ISO of 6/6/03 and 26/7/03.
The 27/6 ISO is 727525376 100%
The xdelta file is 668205179 91.8%
My patch file is 133789668 18.3%
My patch file is much smaller. Xdelta alone is not the answer.
-
Junior Member
registered user
Fair enough, you win although I'm amazed xdellta did so badly.
-
Junior Member
registered user
Originally Posted by
beaky
Fair enough, you win
although I'm amazed xdellta did so badly.
The filesystem is compressed. A fairly small change to the uncompressed file system will change the alignment of the data to the compressed blocks. Every compressed block will resultantly be different. The compressed representation of something slightly different tends to be substantially different. Consequently, there will be very few similarities for xdelta to take advantage of.
My system uncompresses the filesystem, but leaves the structure untouched. The whole file system is chopped into manageable chunks. xdelta is then used to create a patch against those chunks.
On reconstruction, each chunk is joined back together and re-compressed.
My system will only work if the order of the files remain substantially the same and alignment is not moved by more than a few megabytes.
I have made a proposal for xdelta. This involves creating a rolling window for the rolling checksum to allow large files to be diffed with small memory footprint. Xdelta does not currently work on most systems when the target files are gigabytes.
-
Junior Member
registered user
Thinking about it I must have been dealing with uncompressed ISOs. Nice one though to feed the info back to xdelta. Good luck with that!
-
it would really be great for the people that burned it onto cd-rws could update the cd-rw...with a small file...i dont know if its possible though...
Similar Threads
-
By zainabia in forum General Support
Replies: 2
Last Post: 01-08-2004, 04:24 PM
-
By gonefishing in forum General Support
Replies: 1
Last Post: 01-01-2004, 08:57 PM
-
By andymadigan in forum Networking
Replies: 0
Last Post: 11-07-2003, 05:41 AM
-
By bongski55 in forum General Support
Replies: 2
Last Post: 09-10-2003, 03:35 AM
-
By reub2000 in forum Customising & Remastering
Replies: 4
Last Post: 06-04-2003, 07:06 AM
Posting Permissions
- You may not post new threads
- You may not post replies
- You may not post attachments
- You may not edit your posts
-
Forum Rules
HP ProLiant DL380 Gen9 8SFF Server - E5-2698 v3 - 32Cores - 128GB Ram - 1TB HDD
$299.00
HP ProLiant DL380 Gen9 Server 1x Xeon E5-2620V3 2.40 GHz 16 GB RAM No OS No HDD
$114.95
Dell PowerEdge R710 2.5" 2U Server 2x X5670 2.93GHZ 12-Core 128gb 2x 1TB SAS
$214.99
Lenovo SR530 Server (Intel Xeon Silver 4110) (3x 800GB SSD) (NO OS) (48GB RAM)
$599.00
HP ProLiant DL380 G9 Server H240AR 2x Intel Xeon E5-2640 v4 2x800w NO RAM/HDD
$79.00
Dell PowerEdge R620 Server 2x E5-2660 v2 2.2GHz 20 Cores 256GB RAM 1x 480GB SSD
$144.99
Dell PowerEdge R430 - E5-2640 v3 2.60GHz 16GB RAM - NO HDDs
$112.49
HYVE ZEUS V1 1U BAREBONE SERVER W/ X9DRD-LF-TW008 2x HS 1x PSU NO RAM HDD RISER
$114.00
IBM Power S822 8284-22A 12SFF Power8 3.89GHz 6Core 64GB RAM No HDD Server System
$359.99
CTO Dell PowerEdge R630 Server, 2x Xeon E5-2620V4, 64GB- 512GB RAM, 480GB SSDs
$346.67