This release enables logs for the three installed binaries and optimizes
swupd_make_pack performance by preferring to hardlink files to the pack
staging area whenever possible.
Signed-off-by: Patrick McCarty <patrick.mccarty@intel.com>
To capture all information that is logged, change init_log() to make
every log file name unique, and add a call to swupd_make_fullfiles to
enable logging.
Signed-off-by: Patrick McCarty <patrick.mccarty@intel.com>
A big chunk of time during pack creation is spent in untar'ing of
fullfiles tar files. However, we also (most likely) have this exact
same content already in the image/ directory.
This patch makes the pack creator skip the untar if its possible to link
the file directly, and falls back to the existing behavior if the link
fails
Signed-off-by: Patrick McCarty <patrick.mccarty@intel.com>
This release fixes a bug in manifest subtraction logic that may result
in "partial" subtraction of one manifest from another. The fix now
ensures that a manifest can be fully subtracted.
Signed-off-by: Patrick McCarty <patrick.mccarty@intel.com>
In subtract_manifests(), if the two files under consideration have the
same filename but should not be subtracted, a file is skipped in the m2
manifest because there is no "continue" statement at the end of the
first "if" block.
This results in potentially many files not getting subtracted when they
ought to be.
To clarify the logic, avoid using "continue", since it is not needed.
Convert to using one "if" block instead.
Signed-off-by: Patrick McCarty <patrick.mccarty@intel.com>
This release adds support for bsdtar (compile-time option), enables
parallel building of delta packs with pack_maker.sh, adds an initial
functional test suite, and addresses a few bugs:
- Makes parallel pack generation more robust when building packs for
multiple versions simultaneously.
- Fixes basic_creator.sh to work properly on first run.
- Removes an unneeded -a option passed to tar, and fixes tar argument
ordering (files always after options).
- Makes hash calculation always account for xattrs, since swupd-client
unconditionally accounts for them.
Signed-off-by: Patrick McCarty <patrick.mccarty@intel.com>
Even though swupd_make_pack will exit immediately in the event this
error occurs, calling free() here will be needed if the error handling
ever changes (e.g. returning from the function instead of exiting).
Signed-off-by: Patrick McCarty <patrick.mccarty@intel.com>
Because pack generation is a time-consuming task, running this task in
parallel is preferable.
However, if we are generating two or more packs with the same "from"
version at the same time, the multiple jobs will use the same pack
staging directory, leading to corruption.
My solution for now is to use a staging dir with a name derived from
both "from" and "to" versions so that there are no collisions.
A long-term fix will be to implement some kind of locking mechanism to
prevent *identical* packs from being generated simultaneously, but for
now, using more unique staging directories will improve the situation.
Signed-off-by: Patrick McCarty <patrick.mccarty@intel.com>
Since GNU tar fails to extract files with xattrs preserved when
Integrity Measurement Architecture (IMA) is enabled some vendors
may choose to install libarchive-based tar (bsdtar) on their embedded
devices, so the swupd server needs to be able to create archives
in its format.
This patch adds one compile-time options --enable-bsdtar that is used
to enable/disable GNU tar specific options. Also it harmonizes
the command strings to be compatible with both GNU tar and bsdtar.
Particularly it
- changes --exclude pattern from '%s'/* to more explicit '%s/?*' because
bsdtar's pattern matching is greedier than in tar: it uses tcsh's
globbing where '*' can be anything including the null string and the
original pattern would include the directory itself;
- OS file names are escaped with leading ./ to avoid collisions with
file names starting with @ which has special meaning in bsdtar.
Signed-off-by: Dmitry Rozhkov <dmitry.rozhkov@linux.intel.com>
The latest.version file should generally be updated after the most
recent build completes, so bump it to 10 after the build completes for
version 10 in this test.
Signed-off-by: Patrick McCarty <patrick.mccarty@intel.com>
The test suite uses BATS to emit TAP and the Automake TAP driver to
consume the output.
Most of the tests are basic, and full-run.bats creates a minimal update
using autogenerated chroot content.
Signed-off-by: Patrick McCarty <patrick.mccarty@intel.com>
Similar to how swupd_create_update handles argc/argv, swupd_make_pack
and swupd_make_fullfiles should validate the argument count before
checking for root privileges, etc.
Signed-off-by: Patrick McCarty <patrick.mccarty@intel.com>
Currently swupd-client includes xattrs to hash sums of all files.
Therefore in order to avoid relaxing security and to prevent
`swupd verify` from reporting hash mismatches for updated files
it's better to include xattrs to hashes for all files.
Signed-off-by: Dmitry Rozhkov <dmitry.rozhkov@linux.intel.com>
Some of the existing comments cause clang-format to reformat them
strangely, so modify them to something more expected by the tool.
Also, the tool may decide to "join" several lines of concatenated string
literals if a line begins with a macro string literal. That's not
wanted, so fix up that case too.
Signed-off-by: Patrick McCarty <patrick.mccarty@intel.com>
On first run, the formatstaging/latest does not exist, so make sure we
create it and initialize it properly.
Signed-off-by: Patrick McCarty <patrick.mccarty@intel.com>
The mk_groups_ini.sh script instantiates the latest.version file on
first run, so make sure we read contents after that point.
Signed-off-by: Patrick McCarty <patrick.mccarty@intel.com>
In case the user overrides UPDATEDIR in the environment, make sure the
installed server.ini reflects the overridden value.
Signed-off-by: Patrick McCarty <patrick.mccarty@intel.com>
The necessary waits needed for the backgrounded processes is already
implemented, so simply throw swupd_make_pack processes into the
background for faster build times.
Signed-off-by: Patrick McCarty <patrick.mccarty@intel.com>
Unify tar commands to have files enumerated always at the end of
the commands. This would follow the scheme used in tar's man page
and simplify adoption of other tar implementation should the need
arise.
Signed-off-by: Dmitry Rozhkov <dmitry.rozhkov@linux.intel.com>
The -a option is not needed for the extract mode since tar
auto-detects compression type from file format.
Signed-off-by: Dmitry Rozhkov <dmitry.rozhkov@linux.intel.com>
Patrick McCarty