TazPkg Beta needs testing

SliTaz Forum » Community Groups » Devel

TazPkg Beta needs testing

(94 posts) (12 voices)

Started 9 years ago by Aleksej
Latest reply from Aleksej
This topic is closed
This topic is not a support question

Tags:

No tags yet.

« Previous 1…567 Next »

Darjeeling

offline
Member
Used: slitaz-rolling.iso (2015-Dec-27 00:46:36)
Boot: Live CD, Core-Live

1) tazpkg pack changes/corrupts existing /fs tree

This is not a new issue as it has already been a problem in SliTaz 3.0 and possibly even before that. When tazpkg pack is used to create a package from an existing /fs tree it changes the timestamps of all directories and sub-directories in the tree. And, as if that wasn't bad enough, it also changes user and group of all files and directories to root:root if there happen to be /home/tux/... files and directories in the tree, which of course messes up the resulting package as well.

I have a number of more or less static /fs trees that I use to create packages from (opera, redglass-cursors etc.). A couple of days ago I tried to improve the scripts that create the packages with something like this ...
```
   # CSUM=$(tar c $SDIR/$PNAM/fs | md5sum | cut -d " " -f 1)
   CSUM=$(ls -alR $SDIR/$PNAM/fs | md5sum | cut -d " " -f 1)

   if [ "$CSUM" != "$PSUM" ]; then
      echo "The checksums do not match!"
      echo "The calculated sum is: $CSUM"
      echo ""
      exit 1
   fi
```
... to verify the integrity of the /fs tree. But alas, it worked only once because after each run of the script the md5 sum of the tree was a different one.

I'm sure it won't be easy to solve this problem as it lies at the heart of the whole tazpkg thingy. I don't expect it either as it is too special and doesn't affect normal operations of the package manager. But I'm wondering what it is that causes the problem? Is it the use of cpio? Would tar be better?

2) installed packages are not correctly counted and listed

All the issues I have listed here still persist, except for this one ...
```
   TazPanel My packages (manually counted, 500 lines pp) => 247
   missing: xorg-xsetroot
   missing: yad
   present: zlib
```
... which now correctly counts and lists zlib. But the other two "items" are still neither counted nor listed.
Posted 8 years ago #

Aleksej

offline

Coder-hobbyist

Hi Darjeeling,

I can recall only one package with files not belongs to root. So, let's experiment with it.
Package "tazwikiss" files list: http://cook.slitaz.org/cooker.cgi?files=tazwikiss

As you can see, all the files inside the "/var/www/wiki" folder are belongs to user "www" group "www".

Let's repack "tazwikiss":

$ cd /tmp
$ su
# repack tazwikiss

Let's extract repacked package:

# tazpkg extract tazwikiss-250.tazpkg

Let's list all packages files in the long format:

# find tazwikiss-250/fs -type f | xargs ls -l

-rw-r--r-- 1 root root   221 Дек 21 13:55 tazwikiss-250/fs/usr/share/applications/tazcalc.desktop
-rw-r--r-- 1 root root   205 Дек 21 13:55 tazwikiss-250/fs/usr/share/applications/tazwikiss.desktop
-rwxr-xr-x 1 www  www    579 Ноя  7 02:36 tazwikiss-250/fs/var/www/wiki/config-de.sh
-rwxr-xr-x 1 www  www    606 Ноя  7 02:36 tazwikiss-250/fs/var/www/wiki/config-fr.sh
-rwxr-xr-x 1 www  www    522 Ноя  7 02:36 tazwikiss-250/fs/var/www/wiki/config.sh
-rwxr-xr-x 1 www  www  16780 Ноя  7 02:36 tazwikiss-250/fs/var/www/wiki/index.sh
-rwxr-xr-x 1 www  www    712 Ноя  7 02:36 tazwikiss-250/fs/var/www/wiki/pages/Accueil.txt
-rw-r--r-- 1 www  www   1326 Ноя  7 02:36 tazwikiss-250/fs/var/www/wiki/pages/AideCalc.txt
-rw-r--r-- 1 www  www   2461 Ноя  7 02:36 tazwikiss-250/fs/var/www/wiki/pages/AideTables.txt
-rw-r--r-- 1 www  www   4205 Ноя  7 02:36 tazwikiss-250/fs/var/www/wiki/pages/Aide.txt
-rw-r--r-- 1 www  www    918 Ноя  7 02:36 tazwikiss-250/fs/var/www/wiki/pages/Calc.txt
-rw-r--r-- 1 www  www   1277 Ноя  7 02:36 tazwikiss-250/fs/var/www/wiki/pages/HelpCalc.txt
-rw-r--r-- 1 www  www   2416 Ноя  7 02:36 tazwikiss-250/fs/var/www/wiki/pages/HelpTables.txt
-rw-r--r-- 1 www  www   4139 Ноя  7 02:36 tazwikiss-250/fs/var/www/wiki/pages/Help.txt
-rwxr-xr-x 1 www  www    595 Ноя  7 02:36 tazwikiss-250/fs/var/www/wiki/pages/Welcome.txt
-rwxr-xr-x 1 www  www   4308 Ноя  7 02:36 tazwikiss-250/fs/var/www/wiki/plugins/wkp_Admin.sh
-rw-r--r-- 1 www  www    478 Ноя  7 02:36 tazwikiss-250/fs/var/www/wiki/plugins/wkp_Calc.css
-rwxr-xr-x 1 www  www   5746 Ноя  7 02:36 tazwikiss-250/fs/var/www/wiki/plugins/wkp_Calc.sh
-rwxr-xr-x 1 www  www   1751 Ноя  7 02:36 tazwikiss-250/fs/var/www/wiki/plugins/wkp_FullScreen.sh
-rwxr-xr-x 1 www  www   2043 Ноя  7 02:36 tazwikiss-250/fs/var/www/wiki/plugins/wkp_Password.sh
-rwxr-xr-x 1 www  www   1203 Ноя  7 02:36 tazwikiss-250/fs/var/www/wiki/plugins/wkp_Rss.sh
-rwxr-xr-x 1 www  www   1611 Ноя  7 02:36 tazwikiss-250/fs/var/www/wiki/plugins/wkp_Tables.sh
-rwxr-xr-x 1 www  www   2586 Ноя  7 02:36 tazwikiss-250/fs/var/www/wiki/plugins/wkp_Upload.sh
-rwxr-xr-x 1 www  www   2075 Ноя  7 02:36 tazwikiss-250/fs/var/www/wiki/style.css
-rwxr-xr-x 1 www  www   1282 Ноя  7 02:36 tazwikiss-250/fs/var/www/wiki/template.html

As you can see, files still belongs to "www:www".

Now remove repacked package and pack it from extracted fs tree, remove tree and restore it from packed package:

# rm tazwikiss-250.tazpkg
# tazpkg pack tazwikiss-250
# rm -r tazwikiss-250
# tazpkg extract tazwikiss-250.tazpkg

Let's see files list:

# find tazwikiss-250/fs -type f | xargs ls -l

-rw-r--r-- 1 root root   221 Дек 21 13:55 tazwikiss-250/fs/usr/share/applications/tazcalc.desktop
-rw-r--r-- 1 root root   205 Дек 21 13:55 tazwikiss-250/fs/usr/share/applications/tazwikiss.desktop
-rwxr-xr-x 1 www  www    579 Ноя  7 02:36 tazwikiss-250/fs/var/www/wiki/config-de.sh
-rwxr-xr-x 1 www  www    606 Ноя  7 02:36 tazwikiss-250/fs/var/www/wiki/config-fr.sh
-rwxr-xr-x 1 www  www    522 Ноя  7 02:36 tazwikiss-250/fs/var/www/wiki/config.sh
-rwxr-xr-x 1 www  www  16780 Ноя  7 02:36 tazwikiss-250/fs/var/www/wiki/index.sh
-rwxr-xr-x 1 www  www    712 Ноя  7 02:36 tazwikiss-250/fs/var/www/wiki/pages/Accueil.txt
-rw-r--r-- 1 www  www   1326 Ноя  7 02:36 tazwikiss-250/fs/var/www/wiki/pages/AideCalc.txt
-rw-r--r-- 1 www  www   2461 Ноя  7 02:36 tazwikiss-250/fs/var/www/wiki/pages/AideTables.txt
-rw-r--r-- 1 www  www   4205 Ноя  7 02:36 tazwikiss-250/fs/var/www/wiki/pages/Aide.txt
-rw-r--r-- 1 www  www    918 Ноя  7 02:36 tazwikiss-250/fs/var/www/wiki/pages/Calc.txt
-rw-r--r-- 1 www  www   1277 Ноя  7 02:36 tazwikiss-250/fs/var/www/wiki/pages/HelpCalc.txt
-rw-r--r-- 1 www  www   2416 Ноя  7 02:36 tazwikiss-250/fs/var/www/wiki/pages/HelpTables.txt
-rw-r--r-- 1 www  www   4139 Ноя  7 02:36 tazwikiss-250/fs/var/www/wiki/pages/Help.txt
-rwxr-xr-x 1 www  www    595 Ноя  7 02:36 tazwikiss-250/fs/var/www/wiki/pages/Welcome.txt
-rwxr-xr-x 1 www  www   4308 Ноя  7 02:36 tazwikiss-250/fs/var/www/wiki/plugins/wkp_Admin.sh
-rw-r--r-- 1 www  www    478 Ноя  7 02:36 tazwikiss-250/fs/var/www/wiki/plugins/wkp_Calc.css
-rwxr-xr-x 1 www  www   5746 Ноя  7 02:36 tazwikiss-250/fs/var/www/wiki/plugins/wkp_Calc.sh
-rwxr-xr-x 1 www  www   1751 Ноя  7 02:36 tazwikiss-250/fs/var/www/wiki/plugins/wkp_FullScreen.sh
-rwxr-xr-x 1 www  www   2043 Ноя  7 02:36 tazwikiss-250/fs/var/www/wiki/plugins/wkp_Password.sh
-rwxr-xr-x 1 www  www   1203 Ноя  7 02:36 tazwikiss-250/fs/var/www/wiki/plugins/wkp_Rss.sh
-rwxr-xr-x 1 www  www   1611 Ноя  7 02:36 tazwikiss-250/fs/var/www/wiki/plugins/wkp_Tables.sh
-rwxr-xr-x 1 www  www   2586 Ноя  7 02:36 tazwikiss-250/fs/var/www/wiki/plugins/wkp_Upload.sh
-rwxr-xr-x 1 www  www   2075 Ноя  7 02:36 tazwikiss-250/fs/var/www/wiki/style.css
-rwxr-xr-x 1 www  www   1282 Ноя  7 02:36 tazwikiss-250/fs/var/www/wiki/template.html

So, we ended with next: "tazpkg repack" and "tazpkg pack" stores files permissions and ownership.

--------------------

Your script makes you headache because "ls -alR" lists "." and ".." items that can change its timestamp, but it is not an error, and it not touch content and timestamp and permissions/ownership of any file inside fs tree.

Please, change it to "ls -AlR" to exclude "." and ".." and try again.

--------------------

2) installed packages are not correctly counted and listed
missing: xorg-xsetroot
missing: yad

A] Try to find "xorg-xsetroot" and "yad" inside /var/lib/tazpkg/installed.info and inside /var/lib/tazpkg/installed:

grep "^xorg-xsetroot"$'\t' /var/lib/tazpkg/installed.info
grep "^yad"$'\t'           /var/lib/tazpkg/installed.info
ls /var/lib/tazpkg/installed/xorg-xsetroot
ls /var/lib/tazpkg/installed/yad

Does all four commands not fails?

B] Try to get tazpkg info for "xorg-xsetroot" and "yad":

tazpkg info xorg-xsetroot
tazpkg info yad

Does all two commands output that specified packages are installed?

C] Try to fresh reinstall "xorg-xsetroot" and "yad":

# tazpkg -gi xorg-xsetroot --forced
# tazpkg -gi yad --forced

Please try again A] and B].
And please post all the outputs here.

And I very hope that you're using actual versions of the TazPkg and TazPanel...

Posted 8 years ago #

gibor

offline
Moderator

Another bug for tazpkg Version: 5.3.4

root@slitaz:/home/tux# tazpkg remove xorg-xkeyboard-config
The following packages depend on package "xorg-xkeyboard-config":
xorg-server
xorg-setxkbmap
Remove package "xorg-xkeyboard-config" (2.2.1)? (y/N) y

Removing package "xorg-xkeyboard-config"
================================================================================
Removing all files installed... [ Done ]
Removing package receipt... [ Done ]
================================================================================
Package "xorg-xkeyboard-config" (2.2.1) removed.

Remove packages depending on package "xorg-xkeyboard-config"? (y/N) y
tazpkg remove xorg-server
tazpkg remove xorg-setxkbmap
root@slitaz:/home/tux# tazpkg remove xorg-server
The following packages depend on package "xorg-server":
xorg-xf86-input-synaptics
Remove package "xorg-server" (1.12.4)? (y/N) y

Removing package "xorg-server"
================================================================================
Removing all files installed... [ Done ]
Removing package receipt... [ Done ]
================================================================================
Package "xorg-server" (1.12.4) removed.

Remove packages depending on package "xorg-server"? (y/N) n
root@slitaz:/home/tux# tazpkg remove xorg-setxkbmap
Remove package "xorg-setxkbmap" (1.3.0)? (y/N) y

Removing package "xorg-setxkbmap"
================================================================================
Removing all files installed... [ Done ]
Removing package receipt... [ Done ]
================================================================================
Package "xorg-setxkbmap" (1.3.0) removed.

root@slitaz:/home/tux# tazpkg remove xorg-xkbcomp
Remove package "xorg-xkbcomp" (1.2.3)? (y/N) y

Removing package "xorg-xkbcomp"
================================================================================
Removing all files installed... [ Done ]
Removing package receipt... [ Done ]
================================================================================
Package "xorg-xkbcomp" (1.2.3) removed.

Cannot autoremove dependency...

Posted 8 years ago #
Aleksej

offline
Coder-hobbyist

Hi gibor,

Unfortunately, tazpkg you mentioned (and, maybe, used) is too old. Version 5.3.4 was released 9 month ago. Bug you described here has long been fixed.

Posted 8 years ago #
gibor

offline
Moderator

Dont so.. but the test is on slitaz5-rc3 last relese downloaded one mount old.

Posted 8 years ago #
Aleksej

offline
Coder-hobbyist

gibor,
SliTaz RC-3 was released in May, 20 2015 (proof link: http://mirror1.slitaz.org/iso/5.0/ ).
It is not actual anymore.
To test tazpkg please use actual version.

Posted 8 years ago #
gibor

offline
Moderator

Sorry, but I try to test last slitaz release... if on it content packages are broken, anymore not is choose good..
at least have waste my time!

Posted 8 years ago #
Aleksej

offline
Coder-hobbyist

I feel sorry for your lost time.

Latest SliTaz releases called "SliTaz Rolling" or "SliTaz Weekly". You can find them here:
http://mirror1.slitaz.org/iso/rolling/
Read the message in the bottom of that page to choose your ISO.
I advice you to use "slitaz-rolling-core.iso" or "slitaz-rolling.iso" if you unsure.

Posted 8 years ago #
llev

offline
Member

Hi gibor,

RC is for Release _Candidate_: so it may have bugs, this is normal!
:-)

Posted 8 years ago #
Aleksej

offline
Coder-hobbyist

I added README file to the folder: http://mirror1.slitaz.org/iso/5.0/
to not to waste anymore anyone's time.

Posted 8 years ago #
Genesis

offline
Member

Hi Aleksej!

Your idea of adding a Readme at mirror page is very good.

Is it possible to add that text to the home page of SliTaz, "Quick Download" section? By doing this we could help new (and old) users to downloading the most recent version (Weekly).

Have a nice day, man!

Posted 8 years ago #
Aleksej

offline
Coder-hobbyist

Hi Genesis,

Thanks :) I wish you a nice day too!

I just saw http://www.slitaz.org/en/ and http://www.slitaz.org/en/get/ and want greatly change the pages.

http://www.slitaz.org/en/
Section "Latest Release" is confusing.
Section "Quick Download": SliTaz RC-3 should be removed from here.

http://www.slitaz.org/en/get/
Too many information. But that info is sparse and unstructured, I see no "main words" and I'm too lazy to read entire page content.
Section "LiveCD - Cooking version" should be changed to "Rolling".

I'll make the changes in a few days.

Posted 8 years ago #
linuxscripts

offline
Member

Hi Aleksej,
can you read http://forum.slitaz.org/topic/making-packages-without-using-the-wok
I mentioned there that it might (I'm not sure) be useful to change from .cpio.lzma zipping of the fs folder for packages, to .tar.lzma zipping. Perhaps it's something that can be integrated ?

Also, can you tell me whether that cpio (or tar) zipping is really essential at all, or whether just lzma zipping can be done, or alternatively, not integrate any zipping at all (as the .tazpkg file is allready a single file anyway) ?

Posted 8 years ago #
Aleksej

offline
Coder-hobbyist
Hi Genesis,

Now changes is on SliTaz web site:
- http://www.slitaz.org/
- http://www.slitaz.org/get/
Should I change something else?

Hi linuxscripts,

whether just lzma zipping can be done

No. LZMA can pack only single file (or stream). You need to archive your files together using TAR or CPIO. TazPkg uses CPIO and don't use TAR.

Summary: TazPkg uses CPIO to "glue" files together, and uses LZMA to compress "glued" file.

SliTaz ".tazpkg" package anatomy:

Folder "fs" archived using CPIO and archived using LZMA; output is fs.cpio.lzma.

Files "fs.cpio.lzma", "receipt", "files.list", "md5sum", "description.txt" archived together using CPIO; output is package.tazpkg.

Note, GZIP can be used instead of LZMA (producing fs.cpio.gz) for faster package packing and poorer compression grade and bigger package size.
Posted 8 years ago #
totoetsasoeur

offline
Moderator

Dear Aleksej,
Having rolling instead of RC3 for direct download makes much sense. :-)

If I may suggest, you should update as well this web page (http://www.slitaz.org/en/news/) with something like:

01 Jan 2016 - Due to huge improvements, SliTaz 5.0 RC-3 is not available anymore. Please download the latest slitaz_rolling with this link. <and give the link to rolling file>.

Thank you so much for your work.
Best,
Stephane

Posted 8 years ago #

RSS feed for this topic

« Previous 1…567 Next »

Topic Closed

This topic has been closed to new replies.