[devel] ANN: apt-repo with support for local conf and hasher; was: [#153832] FAILED (try 3) ghc7.6.1-language-c.git=0.4.7-alt1

Пн Ноя 30 20:40:01 MSK 2015

2015-11-30 20:12 UTC+03:00, Ivan Zakharyaschev <imz на altlinux.org>:

> Локально не вопроизводится (ни в hasher, ни от root). Установка
> довольно быстро происходит. (Показывать тут особо нечего: и от root, и
> в hasher всё ставится. Иногда печатаются сообщения от триггера с
> haddock.

Тут только можно ещё сообщить о новых возможностях в apt-repo-1.2.2
(только что собрался в Sisyphus; замечания и патчи приветствуются) и
продемонстрировать их: работа с локальными sources.list и команда
apt-repo test, которая теперь может использовать hasher. Больших
преобразований в коде apt-repo это не потребовало.

Вот пример того, что было возможно раньше -- работа с общесистемной
конфигурацией (apt-repo add 153832, apt-repo rm 153832) и тест
установки пакетов из задания сразу одной командой. (..._HACK оказался
нужен из-за отсутствия x86_64-i586 в этом task-е, чего apt-repo update
не мог пережить без ошибки; в общесистемном случае это не страшно, но
в случае такой ошибки в hsh --initroot-only, применение которого будет
продемонстрировано во втором примере, песочница оказывается не
подготовленной начисто. Кстати, замечания для себя: надо бы
прерываться с ошибкой в таком случае, а не пытаться продолжить что-то
сделать в плохой песочнице):

[root на ovicaa ~]# NO_TASK_AREPO_HACK=yes ~imz/bin/apt-repo test 153832
Get:1 http://git.altlinux.org x86_64 release [557B]
Get:2 http://ftp.altlinux.org x86_64 release [915B]
Get:3 http://ftp.altlinux.org noarch release [709B]
Get:4 http://ftp.altlinux.org x86_64-i586 release [573B]
Fetched 2754B in 0s (17,6kB/s)
Hit http://git.altlinux.org x86_64/task pkglist
Hit http://git.altlinux.org x86_64/task release
Get:1 http://ftp.altlinux.org x86_64/classic pkglist [19,0MB]
Get:2 http://ftp.altlinux.org x86_64/classic release [147B]
Get:3 http://ftp.altlinux.org noarch/classic pkglist [4504kB]
Get:4 http://ftp.altlinux.org noarch/classic release [147B]
Get:5 http://ftp.altlinux.org x86_64-i586/classic pkglist [14,2MB]
Get:6 http://ftp.altlinux.org x86_64-i586/classic release [152B]
Fetched 37,7MB in 28s (1312kB/s)
Reading Package Lists... Done
Building Dependency Tree... Done
Reading Package Lists... Done
Building Dependency Tree... Done
The following extra packages will be installed:
  ghc7.6.1 ghc7.6.1-common ghc7.6.1-syb rpm-macros-ghc7.6.1-common
The following packages will be upgraded
  rpm-macros-ghc7.6.1-common
The following NEW packages will be installed:
  ghc7.6.1 ghc7.6.1-common ghc7.6.1-language-c ghc7.6.1-syb
1 upgraded, 4 newly installed, 0 removed and 1589 not upgraded.
Need to get 4351kB/64,4MB of archives.
After unpacking 809MB of additional disk space will be used.
Do you want to continue? [Y/n]
Get:1 http://git.altlinux.org x86_64/task ghc7.6.1-language-c
0.4.7-alt1 [4351kB]
Fetched 4351kB in 0s (6094kB/s)
Committing changes...
Preparing...

###################################################################################################
[100%]
1: rpm-macros-ghc7.6.1-common

###################################################################################################
[ 20%]
2: ghc7.6.1

###################################################################################################
[ 40%]
3: ghc7.6.1-syb

###################################################################################################
[ 60%]
4: ghc7.6.1-common

###################################################################################################
[ 80%]
5: ghc7.6.1-language-c

###################################################################################################
[100%]
Running /usr/lib/rpm/posttrans-filetriggers
Done.
[root на ovicaa ~]# ~imz/bin/apt-repo
rpm [alt] http://ftp.altlinux.org/pub/distributions/ALTLinux/Sisyphus
x86_64 classic
rpm [alt] http://ftp.altlinux.org/pub/distributions/ALTLinux/Sisyphus
noarch classic
rpm [alt] http://ftp.altlinux.org/pub/distributions/ALTLinux/Sisyphus
x86_64-i586 classic
[root на ovicaa ~]#

Вот новая возможность -- используется локальный конфиг и hasher:

[imz на basalt ~]$ NO_TASK_AREPO_HACK=yes apt-repo
--hsh-apt-config=/home/imz/.hasher/sisyphus/apt.conf test 153832
Info: Will use hasher when appropriate (with
--apt-config=/home/imz/.hasher/sisyphus/apt.conf).
Info: will try to read a non-system
APT_CONFIG=/home/imz/.hasher/sisyphus/apt.conf
grep: /var/empty/*.list: Нет такого файла или каталога
grep: /var/empty/*.list: Нет такого файла или каталога
<86>Nov 30 16:14:32 userdel[14788]: delete user 'rooter'
<86>Nov 30 16:14:32 userdel[14788]: removed shadow group 'rooter'
owned by 'rooter'
<86>Nov 30 16:14:32 groupadd[14793]: group added to /etc/group:
name=rooter, GID=562
<86>Nov 30 16:14:32 groupadd[14793]: group added to /etc/gshadow: name=rooter
<86>Nov 30 16:14:32 groupadd[14793]: new group: name=rooter, GID=562
<86>Nov 30 16:14:32 useradd[14797]: new user: name=rooter, UID=562,
GID=562, home=/root, shell=/bin/bash
<86>Nov 30 16:14:33 userdel[14803]: delete user 'builder'
<86>Nov 30 16:14:33 groupadd[14808]: group added to /etc/group:
name=builder, GID=563
<86>Nov 30 16:14:33 groupadd[14808]: group added to /etc/gshadow: name=builder
<86>Nov 30 16:14:33 groupadd[14808]: new group: name=builder, GID=563
<86>Nov 30 16:14:33 useradd[14812]: new user: name=builder, UID=563,
GID=563, home=/usr/src, shell=/bin/bash
<13>Nov 30 16:14:36 rpmi: rpm-macros-ghc7.6.1-common-7.6.1-alt6
1445385767 installed
<13>Nov 30 16:14:36 rpmi: rpm-build-haskell-1-alt26 1445536638 installed
<13>Nov 30 16:14:36 rpmi: haskell-filetrigger-0.0.5-alt2 1445446241 installed
<13>Nov 30 16:14:36 rpmi: libgmp-devel-6.0.0a-alt1 1431516850 installed
<13>Nov 30 16:14:36 rpmi: libffi-devel-1:3.1-alt2 1409163098 installed
<13>Nov 30 16:14:42 rpmi: ghc7.6.1-7.6.1-alt6 1445386600 installed
<13>Nov 30 16:14:42 rpmi: ghc7.6.1-syb-0.3.7-alt2 1356214068 installed
<13>Nov 30 16:14:42 rpmi: ghc7.6.1-common-7.6.1-alt6 1445385767 installed
<13>Nov 30 16:14:43 rpmi: ghc7.6.1-language-c-0.4.7-alt1 1448649016 installed
Warning: haddock-interfaces:
/usr/share/doc/ghc7.6.1-7.6.1/libraries/unix-2.6.0.0/unix.haddock
doesn't exist or isn't a file
Warning: haddock-html:
/usr/share/doc/ghc7.6.1-7.6.1/libraries/unix-2.6.0.0 doesn't exist or
isn't a directory
Warning: haddock-interfaces:
/usr/share/doc/ghc7.6.1-7.6.1/libraries/time-1.4.0.1/time.haddock
doesn't exist or isn't a file
Warning: haddock-html:
/usr/share/doc/ghc7.6.1-7.6.1/libraries/time-1.4.0.1 doesn't exist or
isn't a directory
Warning: haddock-interfaces:
/usr/share/doc/ghc7.6.1-7.6.1/libraries/template-haskell-2.8.0.0/template-haskell.haddock
doesn't exist or isn't a file
Warning: haddock-html:
/usr/share/doc/ghc7.6.1-7.6.1/libraries/template-haskell-2.8.0.0
doesn't exist or isn't a directory
Warning: haddock-interfaces:
/usr/share/doc/ghc7.6.1-7.6.1/libraries/process-1.1.0.2/process.haddock
doesn't exist or isn't a file
Warning: haddock-html:
/usr/share/doc/ghc7.6.1-7.6.1/libraries/process-1.1.0.2 doesn't exist
or isn't a directory
Warning: haddock-interfaces:
/usr/share/doc/ghc7.6.1-7.6.1/libraries/pretty-1.1.1.0/pretty.haddock
doesn't exist or isn't a file
Warning: haddock-html:
/usr/share/doc/ghc7.6.1-7.6.1/libraries/pretty-1.1.1.0 doesn't exist
or isn't a directory
Warning: haddock-interfaces:
/usr/share/doc/ghc7.6.1-7.6.1/libraries/old-time-1.1.0.1/old-time.haddock
doesn't exist or isn't a file
Warning: haddock-html:
/usr/share/doc/ghc7.6.1-7.6.1/libraries/old-time-1.1.0.1 doesn't exist
or isn't a directory
Warning: haddock-interfaces:
/usr/share/doc/ghc7.6.1-7.6.1/libraries/old-locale-1.0.0.5/old-locale.haddock
doesn't exist or isn't a file
Warning: haddock-html:
/usr/share/doc/ghc7.6.1-7.6.1/libraries/old-locale-1.0.0.5 doesn't
exist or isn't a directory
Warning: haddock-interfaces:
/usr/share/doc/ghc7.6.1-7.6.1/libraries/integer-gmp-0.5.0.0/integer-gmp.haddock
doesn't exist or isn't a file
Warning: haddock-html:
/usr/share/doc/ghc7.6.1-7.6.1/libraries/integer-gmp-0.5.0.0 doesn't
exist or isn't a directory
Warning: haddock-interfaces:
/usr/share/doc/ghc7.6.1-7.6.1/libraries/hpc-0.6.0.0/hpc.haddock
doesn't exist or isn't a file
Warning: haddock-html:
/usr/share/doc/ghc7.6.1-7.6.1/libraries/hpc-0.6.0.0 doesn't exist or
isn't a directory
Warning: haddock-interfaces:
/usr/share/doc/ghc7.6.1-7.6.1/libraries/hoopl-3.9.0.0/hoopl.haddock
doesn't exist or isn't a file
Warning: haddock-html:
/usr/share/doc/ghc7.6.1-7.6.1/libraries/hoopl-3.9.0.0 doesn't exist or
isn't a directory
Warning: haddock-interfaces:
/usr/share/doc/ghc7.6.1-7.6.1/libraries/haskell98-2.0.0.2/haskell98.haddock
doesn't exist or isn't a file
Warning: haddock-html:
/usr/share/doc/ghc7.6.1-7.6.1/libraries/haskell98-2.0.0.2 doesn't
exist or isn't a directory
Warning: haddock-interfaces:
/usr/share/doc/ghc7.6.1-7.6.1/libraries/haskell2010-1.1.1.0/haskell2010.haddock
doesn't exist or isn't a file
Warning: haddock-html:
/usr/share/doc/ghc7.6.1-7.6.1/libraries/haskell2010-1.1.1.0 doesn't
exist or isn't a directory
Warning: haddock-interfaces:
/usr/share/doc/ghc7.6.1-7.6.1/libraries/ghc-prim-0.3.0.0/ghc-prim.haddock
doesn't exist or isn't a file
Warning: haddock-html:
/usr/share/doc/ghc7.6.1-7.6.1/libraries/ghc-prim-0.3.0.0 doesn't exist
or isn't a directory
Warning: haddock-interfaces:
/usr/share/doc/ghc7.6.1-7.6.1/libraries/ghc-7.6.1/ghc.haddock doesn't
exist or isn't a file
Warning: haddock-html:
/usr/share/doc/ghc7.6.1-7.6.1/libraries/ghc-7.6.1 doesn't exist or
isn't a directory
Warning: haddock-interfaces:
/usr/share/doc/ghc7.6.1-7.6.1/libraries/filepath-1.3.0.1/filepath.haddock
doesn't exist or isn't a file
Warning: haddock-html:
/usr/share/doc/ghc7.6.1-7.6.1/libraries/filepath-1.3.0.1 doesn't exist
or isn't a directory
Warning: haddock-interfaces:
/usr/share/doc/ghc7.6.1-7.6.1/libraries/directory-1.2.0.0/directory.haddock
doesn't exist or isn't a file
Warning: haddock-html:
/usr/share/doc/ghc7.6.1-7.6.1/libraries/directory-1.2.0.0 doesn't
exist or isn't a directory
Warning: haddock-interfaces:
/usr/share/doc/ghc7.6.1-7.6.1/libraries/deepseq-1.3.0.1/deepseq.haddock
doesn't exist or isn't a file
Warning: haddock-html:
/usr/share/doc/ghc7.6.1-7.6.1/libraries/deepseq-1.3.0.1 doesn't exist
or isn't a directory
Warning: haddock-interfaces:
/usr/share/doc/ghc7.6.1-7.6.1/libraries/containers-0.5.0.0/containers.haddock
doesn't exist or isn't a file
Warning: haddock-html:
/usr/share/doc/ghc7.6.1-7.6.1/libraries/containers-0.5.0.0 doesn't
exist or isn't a directory
Warning: haddock-interfaces:
/usr/share/doc/ghc7.6.1-7.6.1/libraries/bytestring-0.10.0.0/bytestring.haddock
doesn't exist or isn't a file
Warning: haddock-html:
/usr/share/doc/ghc7.6.1-7.6.1/libraries/bytestring-0.10.0.0 doesn't
exist or isn't a directory
Warning: haddock-interfaces:
/usr/share/doc/ghc7.6.1-7.6.1/libraries/binary-0.5.1.1/binary.haddock
doesn't exist or isn't a file
Warning: haddock-html:
/usr/share/doc/ghc7.6.1-7.6.1/libraries/binary-0.5.1.1 doesn't exist
or isn't a directory
Warning: haddock-interfaces:
/usr/share/doc/ghc7.6.1-7.6.1/libraries/bin-package-db-0.0.0.0/bin-package-db.haddock
doesn't exist or isn't a file
Warning: haddock-html:
/usr/share/doc/ghc7.6.1-7.6.1/libraries/bin-package-db-0.0.0.0 doesn't
exist or isn't a directory
Warning: haddock-interfaces:
/usr/share/doc/ghc7.6.1-7.6.1/libraries/base-4.6.0.0/base.haddock
doesn't exist or isn't a file
Warning: haddock-html:
/usr/share/doc/ghc7.6.1-7.6.1/libraries/base-4.6.0.0 doesn't exist or
isn't a directory
Warning: haddock-interfaces:
/usr/share/doc/ghc7.6.1-7.6.1/libraries/array-0.4.0.1/array.haddock
doesn't exist or isn't a file
Warning: haddock-html:
/usr/share/doc/ghc7.6.1-7.6.1/libraries/array-0.4.0.1 doesn't exist or
isn't a directory
Warning: haddock-interfaces:
/usr/share/doc/ghc7.6.1-7.6.1/libraries/Cabal-1.16.0/Cabal.haddock
doesn't exist or isn't a file
Warning: haddock-html:
/usr/share/doc/ghc7.6.1-7.6.1/libraries/Cabal-1.16.0 doesn't exist or
isn't a directory
grep: /var/empty/*.list: Нет такого файла или каталога
sed: невозможно прочитать /var/empty/*.list: Нет такого файла или каталога
[imz на basalt ~]$ apt-repo --hsh-apt-config=/home/imz/.hasher/sisyphus/apt.conf
Info: Will use hasher when appropriate (with
--apt-config=/home/imz/.hasher/sisyphus/apt.conf).
Info: will try to read a non-system
APT_CONFIG=/home/imz/.hasher/sisyphus/apt.conf
grep: /var/empty/*.list: Нет такого файла или каталога
rpm [alt] file:/ALT/Sisyphus x86_64 classic
rpm [alt] file:/ALT/Sisyphus noarch classic
[imz на basalt ~]$ cat ~/.hasher/sisyphus/apt.conf
Dir::Etc {
	 sourcelist "/home/imz/.hasher/sisyphus/sources.list";
	 sourceparts "/var/empty/";
};
[imz на basalt ~]$

> ---------- Forwarded message ----------
> From: Girar Builder awaiter robot <girar-builder на altlinux.org>
> Date: Fri, 27 Nov 2015 20:34:08 +0000
> Subject: [#153832] FAILED (try 3) ghc7.6.1-language-c.git=0.4.7-alt1
> To: Ivan Zakharyaschev <imz на altlinux.org>
> Cc: sisyphus-incominger на lists.altlinux.org
>
> http://git.altlinux.org/tasks/153832/logs/events.3.1.log
>
> 2015-Nov-27 18:21:25 :: task #153832 for sisyphus resumed by imz:
> #100 build 0.4.7-alt1 from /people/imz/packages/ghc7.6.1-language-c.git
> 2015-Nov-27 18:21:26 :: [x86_64] #100 ghc7.6.1-language-c.git
> 0.4.7-alt1: build start
> 2015-Nov-27 18:21:26 :: [i586] #100 ghc7.6.1-language-c.git
> 0.4.7-alt1: build start
> 2015-Nov-27 18:30:00 :: [i586] #100 ghc7.6.1-language-c.git 0.4.7-alt1:
> build OK
> 2015-Nov-27 18:31:01 :: [x86_64] #100 ghc7.6.1-language-c.git
> 0.4.7-alt1: build OK
> 2015-Nov-27 18:31:05 :: build check OK
> 2015-Nov-27 18:31:07 :: noarch check OK
> 2015-Nov-27 18:31:08 :: plan: src +1 -1 =18364, i586 +2 -2 =34945,
> x86_64 +2 -2 =34881
> 2015-Nov-27 18:31:08 :: version check OK
> 2015-Nov-27 18:32:22 :: generated apt indices
> 2015-Nov-27 18:32:22 :: created next repo
> 2015-Nov-27 18:32:38 :: dependencies check OK
> 2015-Nov-27 18:33:07 :: ELF symbols check OK
> 2015-Nov-27 19:18:33 :: [i586] #100 ghc7.6.1-language-c: install check OK
> 	x86_64: ghc7.6.1-language-c=0.4.7-alt1 preinstall failed:
> <13>Nov 27 18:33:30 rpmi: libffi6-1:3.1-alt2 1409163098 installed
> <13>Nov 27 18:33:30 rpmi: rpm-macros-ghc7.6.1-common-7.6.1-alt6
> 1445385767 installed
> <13>Nov 27 18:33:30 rpmi: rpm-build-haskell-1-alt26 1445536638 installed
> <13>Nov 27 18:33:30 rpmi: haskell-filetrigger-0.0.5-alt2 1445446241
> installed
> <13>Nov 27 18:33:30 rpmi: libgmp-devel-6.0.0a-alt1 1431516850 installed
> <13>Nov 27 18:33:30 rpmi: glib2-locales-2.46.2-alt1 1446853826 installed
> <13>Nov 27 18:33:30 rpmi: glib2-2.46.2-alt1 1446853786 installed
> <13>Nov 27 18:33:30 rpmi: pkg-config-0.25-alt2 1298849081 installed
> <13>Nov 27 18:33:30 rpmi: libffi-devel-1:3.1-alt2 1409163098 installed
> <13>Nov 27 18:33:39 rpmi: ghc7.6.1-7.6.1-alt6 1445386600 installed
> <13>Nov 27 18:33:39 rpmi: ghc7.6.1-common-7.6.1-alt6 1445385767 installed
> <13>Nov 27 18:33:40 rpmi: ghc7.6.1-syb-0.3.7-alt2 1356214068 installed
>
> hasher-priv: master: idle time limit (3600 seconds) exceeded
> hsh-install: Packages installation failed.
> 2015-Nov-27 19:33:40 :: [x86_64] #100 ghc7.6.1-language-c: install check
> FAILED
> 2015-Nov-27 19:34:11 :: [i586] #100 ghc7.6.1-language-c-debuginfo:
> install check OK
> 	x86_64: ghc7.6.1-language-c-debuginfo=0.4.7-alt1 preinstall failed:
> <13>Nov 27 19:33:55 rpmi: glibc-core-debuginfo-6:2.17-alt8 1389812223
> installed
> <13>Nov 27 19:33:55 rpmi: libffi6-1:3.1-alt2 1409163098 installed
> <13>Nov 27 19:33:55 rpmi: libffi6-debuginfo-1:3.1-alt2 1409163098 installed
> <13>Nov 27 19:33:55 rpmi: libgmp10-debuginfo-6.0.0a-alt1 1431516850
> installed
> <13>Nov 27 19:33:55 rpmi: glibc-pthread-debuginfo-6:2.17-alt8
> 1389812223 installed
> <13>Nov 27 19:33:55 rpmi: libtinfo-debuginfo-5.9-alt7 1442415999 installed
> <13>Nov 27 19:33:55 rpmi: rpm-macros-ghc7.6.1-common-7.6.1-alt6
> 1445385767 installed
> <13>Nov 27 19:33:55 rpmi: rpm-build-haskell-1-alt26 1445536638 installed
> <13>Nov 27 19:33:55 rpmi: haskell-filetrigger-0.0.5-alt2 1445446241
> installed
> <13>Nov 27 19:33:55 rpmi: libgmp-devel-6.0.0a-alt1 1431516850 installed
> <13>Nov 27 19:33:55 rpmi: glib2-locales-2.46.2-alt1 1446853826 installed
> <13>Nov 27 19:33:55 rpmi: glib2-2.46.2-alt1 1446853786 installed
> <13>Nov 27 19:33:55 rpmi: pkg-config-0.25-alt2 1298849081 installed
> <13>Nov 27 19:33:55 rpmi: libffi-devel-1:3.1-alt2 1409163098 installed
> <13>Nov 27 19:34:05 rpmi: ghc7.6.1-7.6.1-alt6 1445386600 installed
> <13>Nov 27 19:34:05 rpmi: ghc7.6.1-syb-0.3.7-alt2 1356214068 installed
> <13>Nov 27 19:34:05 rpmi: ghc7.6.1-common-7.6.1-alt6 1445385767 installed
> <13>Nov 27 19:34:06 rpmi: ghc7.6.1-debuginfo-7.6.1-alt6 1445386600
> installed
> <13>Nov 27 19:34:07 rpmi: ghc7.6.1-language-c-0.4.7-alt1 1448649016
> installed
>
> hasher-priv: master: idle time limit (3600 seconds) exceeded
> hsh-install: Packages installation failed.
> 2015-Nov-27 20:34:07 :: [x86_64] #100 ghc7.6.1-language-c-debuginfo:
> install check FAILED
> 2015-Nov-27 20:34:08 :: [x86_64] install check FAILED
> 2015-Nov-27 20:34:08 :: task #153832 for sisyphus FAILED

-- 
Ivan