nixpkgs/nixos/tests
Léo Gaspard 02e1f00ffd
dovecot, opensmtpd: add link to test in meta.tests
Rationale
---------

Currently, tests are hard to discover. For instance, someone updating
`dovecot` might not notice that the interaction of `dovecot` with
`opensmtpd` is handled in the `opensmtpd.nix` test.

And even for someone updating `opensmtpd`, it requires manual work to go
check in `nixos/tests` whether there is actually a test, especially
given not so many packages in `nixpkgs` have tests and this is thus most
of the time useless.

Finally, for the reviewer, it is much easier to check that the “Tested
via one or more NixOS test(s)” has been checked if the file modified
already includes the list of relevant tests.

Implementation
--------------

Currently, this commit only adds the metadata in the package. Each
element of the `meta.tests` attribute is a derivation that, when it
builds successfully, means the test has passed (ie. following the same
convention as NixOS tests).

Future Work
-----------

In the future, the tools could be made aware of this `meta.tests`
attribute, and for instance a `--with-tests` could be added to
`nix-build` so that it also builds all the tests. Or a `--without-tests`
to build without all the tests. @Profpatsch described in his NixCon talk
such systems.

Another thing that would help in the future would be the possibility to
reasonably easily have cross-derivation nix tests without the whole
NixOS VM stack. @7c6f434c already proposed such a system.

This RFC currently handles none of these concerns. Only the addition of
`meta.tests` as metadata to be used by maintainers to remember to run
relevant tests.
2018-10-30 21:31:39 +09:00
..
common nixos tests: move common configuration into separate file 2018-09-24 20:07:33 +01:00
hadoop [bot] nixos/*: remove unused arguments in lambdas 2018-07-20 20:56:59 +00:00
hitch [bot] nixos/*: remove unused arguments in lambdas 2018-07-20 20:56:59 +00:00
hocker-fetchdocker [bot] nixos/*: remove unused arguments in lambdas 2018-07-20 20:56:59 +00:00
hydra hydra: 2017-11-21 -> 2018-08-07 2018-08-13 22:56:27 +02:00
initrd-network-ssh [bot] nixos/*: remove unused arguments in lambdas 2018-07-20 20:56:59 +00:00
krb5 [bot] nixos/*: remove unused arguments in lambdas 2018-07-20 20:56:59 +00:00
kubernetes [bot] nixos/*: remove unused arguments in lambdas 2018-07-20 20:56:59 +00:00
nextcloud nixos/nextcloud: init 2018-10-01 02:07:43 +09:30
acme.nix nixos tests: move common configuration into separate file 2018-09-24 20:07:33 +01:00
ammonite.nix [bot] nixos/*: remove unused arguments in lambdas 2018-07-20 20:56:59 +00:00
atd.nix nixos/tests/atd: wait for atd to start 2018-09-21 09:22:03 +02:00
avahi.nix [bot] nixos/*: remove unused arguments in lambdas 2018-07-20 20:56:59 +00:00
bcachefs.nix nixos/tests/bcachefs: init 2018-08-31 21:19:53 -05:00
beegfs.nix [bot] nixos/*: remove unused arguments in lambdas 2018-07-20 20:56:59 +00:00
bind.nix nixos/bind: Allow to set extra options 2018-05-30 05:07:39 +02:00
bittorrent.nix tests: bittorrent: add bobvanderlinden as maintainer 2018-09-15 23:10:26 +02:00
blivet.nix blivet test: use python2 2016-11-24 22:28:03 +01:00
boot-stage1.nix nixos.tests.boot-stage1: fix missing libelf 2018-02-22 04:04:49 +01:00
boot.nix Fix installing the Nixpkgs channel on the installation media 2018-02-27 19:58:23 +01:00
borgbackup.nix [bot] nixos/*: remove unused arguments in lambdas 2018-07-20 20:56:59 +00:00
buildbot.nix buildbot: add Python 3 support 2018-10-11 21:39:11 -04:00
cadvisor.nix [bot] nixos/*: remove unused arguments in lambdas 2018-07-20 20:56:59 +00:00
cassandra.nix cassandra: rewrote service from scratch 2018-08-07 14:48:43 +00:00
ceph.nix [bot] nixos/*: remove unused arguments in lambdas 2018-07-20 20:56:59 +00:00
certmgr.nix nixos/certmgr: init 2018-08-10 09:56:25 +02:00
cfssl.nix nixos/cfssl: init 2018-08-03 09:40:32 +02:00
chromium.nix nixos/tests/chromium: Wait 10s after new window 2018-04-28 17:35:13 +02:00
cjdns.nix [bot] nixos/*: remove unused arguments in lambdas 2018-07-20 20:56:59 +00:00
cloud-init.nix [bot] nixos/*: remove unused arguments in lambdas 2018-07-20 20:56:59 +00:00
codimd.nix nixos/tests: fix non-determinism for good 2018-10-10 14:57:43 +02:00
containers-bridge.nix [bot] nixos/*: remove unused arguments in lambdas 2018-07-20 20:56:59 +00:00
containers-extra_veth.nix [bot] nixos/*: remove unused arguments in lambdas 2018-07-20 20:56:59 +00:00
containers-hosts.nix [bot] nixos/*: remove unused arguments in lambdas 2018-07-20 20:56:59 +00:00
containers-imperative.nix nixos/containers: Add regression test for #40355 2018-10-08 10:55:42 +02:00
containers-ipv4.nix Revert "nixos: rename system.{stateVersion,defaultChannel} -> system.nixos.\1" 2018-07-28 00:12:55 +03:00
containers-ipv6.nix [bot] nixos/*: remove unused arguments in lambdas 2018-07-20 20:56:59 +00:00
containers-macvlans.nix [bot] nixos/*: remove unused arguments in lambdas 2018-07-20 20:56:59 +00:00
containers-physical_interfaces.nix [bot] nixos/*: remove unused arguments in lambdas 2018-07-20 20:56:59 +00:00
containers-portforward.nix [bot] nixos/*: remove unused arguments in lambdas 2018-07-20 20:56:59 +00:00
containers-reloadable.nix [bot] nixos/*: remove unused arguments in lambdas 2018-07-20 20:56:59 +00:00
containers-restart_networking.nix [bot] nixos/*: remove unused arguments in lambdas 2018-07-20 20:56:59 +00:00
containers-tmpfs.nix [bot] nixos/*: remove unused arguments in lambdas 2018-07-20 20:56:59 +00:00
couchdb.nix [bot] nixos/*: remove unused arguments in lambdas 2018-07-20 20:56:59 +00:00
deluge.nix [bot] nixos/*: remove unused arguments in lambdas 2018-07-20 20:56:59 +00:00
dhparams.nix nixos/dhparams: Add a defaultBitSize option 2018-05-07 04:58:52 +02:00
dnscrypt-proxy.nix [bot] nixos/*: remove unused arguments in lambdas 2018-07-20 20:56:59 +00:00
docker-edge.nix [bot] nixos/*: remove unused arguments in lambdas 2018-07-20 20:56:59 +00:00
docker-registry.nix [bot] nixos/*: remove unused arguments in lambdas 2018-07-20 20:56:59 +00:00
docker-tools-overlay.nix [bot] nixos/*: remove unused arguments in lambdas 2018-07-20 20:56:59 +00:00
docker-tools.nix dockerTools: test buildLayeredImage 2018-09-27 14:19:43 -04:00
docker.nix [bot] nixos/*: remove unused arguments in lambdas 2018-07-20 20:56:59 +00:00
dovecot.nix dovecot module: test dovecot's LDA 2018-04-12 01:35:14 +02:00
ec2.nix qemu: 2.12.1 -> 3.0.0 2018-08-20 22:02:02 +00:00
ecryptfs.nix [bot] nixos/*: remove unused arguments in lambdas 2018-07-20 20:56:59 +00:00
elk.nix nixos/tests/elk.nix: make sure the test doesn't wait for too long on elasticsearch-curator 2018-08-25 18:53:10 +02:00
emacs-daemon.nix [bot] nixos/*: remove unused arguments in lambdas 2018-07-20 20:56:59 +00:00
env.nix [bot] nixos/*: remove unused arguments in lambdas 2018-07-20 20:56:59 +00:00
etcd-cluster.nix [bot] nixos/*: remove unused arguments in lambdas 2018-07-20 20:56:59 +00:00
etcd.nix [bot] nixos/*: remove unused arguments in lambdas 2018-07-20 20:56:59 +00:00
ferm.nix nixos/tests/ferm: disable dhcpcd 2018-09-21 01:17:41 +02:00
firefox.nix [bot] nixos/*: remove unused arguments in lambdas 2018-07-20 20:56:59 +00:00
firewall.nix [bot] nixos/*: remove unused arguments in lambdas 2018-07-20 20:56:59 +00:00
flannel.nix [bot] nixos/*: remove unused arguments in lambdas 2018-07-20 20:56:59 +00:00
flatpak.nix nixos/tests/flatpak: explicitly disable gdm to fix eval 2018-09-02 01:57:20 +02:00
fsck.nix systemd: ensure fsck Requires/After links are created in mount units 2018-08-28 17:12:49 +02:00
fwupd.nix [bot] nixos/*: remove unused arguments in lambdas 2018-07-20 20:56:59 +00:00
gdk-pixbuf.nix nixos/tests/gdk-pixbuf: fix test on i686 (#46916) 2018-09-20 21:29:37 +02:00
gitlab.nix [bot] nixos/*: remove unused arguments in lambdas 2018-07-20 20:56:59 +00:00
gitolite.nix [bot] nixos/*: remove unused arguments in lambdas 2018-07-20 20:56:59 +00:00
gjs.nix nixos/gjs: add test 2018-02-14 22:43:59 +01:00
gnome3-gdm.nix xserver.displayManager: change default 2018-08-31 17:57:39 +02:00
gnome3.nix xserver.displayManager: change default 2018-08-31 17:57:39 +02:00
gocd-agent.nix [bot] nixos/*: remove unused arguments in lambdas 2018-07-20 20:56:59 +00:00
gocd-server.nix [bot] nixos/*: remove unused arguments in lambdas 2018-07-20 20:56:59 +00:00
grafana.nix [bot] nixos/*: remove unused arguments in lambdas 2018-07-20 20:56:59 +00:00
graphite.nix graphite: 1.0.2 -> 1.1.3 & moved dependencies to python-modules (#44276) 2018-08-02 16:39:57 +02:00
haka.nix [bot] nixos/*: remove unused arguments in lambdas 2018-07-20 20:56:59 +00:00
haproxy.nix [bot] nixos/*: remove unused arguments in lambdas 2018-07-20 20:56:59 +00:00
hardened.nix [bot] nixos/*: remove unused arguments in lambdas 2018-07-20 20:56:59 +00:00
hibernate.nix nixos/tests/hibernate: prevent non-deterministic failure (#46882) 2018-09-19 16:19:45 +02:00
home-assistant.nix home-assistant: 0.75.2 -> 0.76.1 2018-08-21 19:26:54 +02:00
hound.nix nixos/tests/hound: fix non-deterministic failure (#47152) 2018-09-24 17:31:46 +02:00
i3wm.nix nixos/tests/i3wm: prevent non-deterministic failure (#45759) 2018-08-29 19:38:35 +02:00
iftop.nix nixos/tests/iftop: fix non-deterministic failure (#41309) 2018-06-01 22:27:51 +02:00
influxdb.nix [bot] nixos/*: remove unused arguments in lambdas 2018-07-20 20:56:59 +00:00
initrd-network.nix [bot] nixos/*: remove unused arguments in lambdas 2018-07-20 20:56:59 +00:00
installer.nix nixos/tests/installer: stop udev queue before calling mdadm 2018-09-22 12:33:15 +02:00
ipfs.nix [bot] nixos/*: remove unused arguments in lambdas 2018-07-20 20:56:59 +00:00
ipv6.nix [bot] nixos/*: remove unused arguments in lambdas 2018-07-20 20:56:59 +00:00
jenkins.nix [bot] nixos/*: remove unused arguments in lambdas 2018-07-20 20:56:59 +00:00
kafka.nix [bot] nixos/*: remove unused arguments in lambdas 2018-07-20 20:56:59 +00:00
kernel-latest.nix [bot] nixos/*: remove unused arguments in lambdas 2018-07-20 20:56:59 +00:00
kernel-lts.nix [bot] nixos/*: remove unused arguments in lambdas 2018-07-20 20:56:59 +00:00
kexec.nix [bot] nixos/*: remove unused arguments in lambdas 2018-07-20 20:56:59 +00:00
keymap.nix nixos/tests/keymap: wait for xdotool to succeed 2018-04-25 10:16:52 +02:00
ldap.nix [bot] nixos/*: remove unused arguments in lambdas 2018-07-20 20:56:59 +00:00
leaps.nix nixos/tests/leaps.nix: fixed race condition 2017-03-06 21:33:21 +01:00
lightdm.nix [bot] nixos/*: remove unused arguments in lambdas 2018-07-20 20:56:59 +00:00
login.nix [bot] nixos/*: remove unused arguments in lambdas 2018-07-20 20:56:59 +00:00
make-test.nix nixos/tests/make-test.nix: Fix eval error 2018-02-02 17:44:08 +01:00
mathics.nix [bot] nixos/*: remove unused arguments in lambdas 2018-07-20 20:56:59 +00:00
matrix-synapse.nix nixos/tests/matrix-synapse: fix test (#45596) 2018-08-26 10:38:52 +02:00
memcached.nix [bot] nixos/*: remove unused arguments in lambdas 2018-07-20 20:56:59 +00:00
mesos.nix nixos/tests/mesos: fix test (#45758) 2018-08-29 19:38:00 +02:00
mesos_test.py mesos: 1.0.1 -> 1.1.0 2016-12-29 20:09:46 -05:00
minio.nix [bot] nixos/*: remove unused arguments in lambdas 2018-07-20 20:56:59 +00:00
misc.nix nixos/tests/misc: Fix reboot-wtmp subtest 2018-10-03 03:57:28 +02:00
mongodb.nix [bot] nixos/*: remove unused arguments in lambdas 2018-07-20 20:56:59 +00:00
morty.nix [bot] nixos/*: remove unused arguments in lambdas 2018-07-20 20:56:59 +00:00
mpd.nix [bot] nixos/*: remove unused arguments in lambdas 2018-07-20 20:56:59 +00:00
mpich-example.c Move all of NixOS to nixos/ in preparation of the repository merge 2013-10-10 13:28:20 +02:00
mumble.nix [bot] nixos/*: remove unused arguments in lambdas 2018-07-20 20:56:59 +00:00
munin.nix nixos/tests/munin: fix non-deterministic failure 2018-08-25 14:27:41 +02:00
mutable-users.nix [bot] nixos/*: remove unused arguments in lambdas 2018-07-20 20:56:59 +00:00
mysql-backup.nix [bot] nixos/*: remove unused arguments in lambdas 2018-07-20 20:56:59 +00:00
mysql-replication.nix [bot] nixos/*: remove unused arguments in lambdas 2018-07-20 20:56:59 +00:00
mysql.nix [bot] nixos/*: remove unused arguments in lambdas 2018-07-20 20:56:59 +00:00
nat.nix [bot] nixos/*: remove unused arguments in lambdas 2018-07-20 20:56:59 +00:00
netdata.nix nixos/tests/netdata: fix non-deterministic failure 2018-08-26 13:38:58 +02:00
networking-proxy.nix [bot] nixos/*: remove unused arguments in lambdas 2018-07-20 20:56:59 +00:00
networking.nix nixos/tests/networking.virtual: prevent non-deterministic failure (#46949) 2018-09-20 13:20:12 +02:00
nexus.nix [bot] nixos/*: remove unused arguments in lambdas 2018-07-20 20:56:59 +00:00
nfs.nix nixos/tests/nfs: fix nfs4 client mount path 2018-08-30 19:57:39 +02:00
nghttpx.nix nixos/nghttpx: add module for the nghttpx proxy server (#31680) 2017-11-16 18:21:02 +00:00
nginx.nix [bot] nixos/*: remove unused arguments in lambdas 2018-07-20 20:56:59 +00:00
nix-ssh-serve.nix nixos/tests/nix-ssh-serve.nix: Use stable nix (#47584) 2018-10-01 23:01:38 +02:00
novacomd.nix nixos/tests/novacomd: prevent non-deterministic failure 2018-09-04 22:46:44 +02:00
nsd.nix nixos/nsd: Allow to configure root zone 2018-05-07 04:05:41 +02:00
openldap.nix nixos/tests/openldap: Fix name 2018-04-04 18:26:41 +03:00
opensmtpd.nix dovecot, opensmtpd: add link to test in meta.tests 2018-10-30 21:31:39 +09:00
openssh.nix [bot] nixos/*: remove unused arguments in lambdas 2018-07-20 20:56:59 +00:00
osquery.nix nixos/osquery: add test 2018-04-30 16:49:38 +02:00
ostree.nix ostree: 2018.4 → 2018.6 2018-06-24 16:10:32 +02:00
owncloud.nix [bot] nixos/*: remove unused arguments in lambdas 2018-07-20 20:56:59 +00:00
pam-oath-login.nix [bot] nixos/*: remove unused arguments in lambdas 2018-07-20 20:56:59 +00:00
partition.nix [bot] nixos/*: remove unused arguments in lambdas 2018-07-20 20:56:59 +00:00
peerflix.nix [bot] nixos/*: remove unused arguments in lambdas 2018-07-20 20:56:59 +00:00
pgjwt.nix [bot] nixos/*: remove unused arguments in lambdas 2018-07-20 20:56:59 +00:00
pgmanage.nix postage: replaced by pgmanage-10.0.2 2017-11-03 00:14:00 +01:00
phabricator.nix [bot] nixos/*: remove unused arguments in lambdas 2018-07-20 20:56:59 +00:00
php-pcre.nix [bot] nixos/*: remove unused arguments in lambdas 2018-07-20 20:56:59 +00:00
plasma5.nix [bot] nixos/*: remove unused arguments in lambdas 2018-07-20 20:56:59 +00:00
plotinus.nix [bot] nixos/*: remove unused arguments in lambdas 2018-07-20 20:56:59 +00:00
postgis.nix [bot] nixos/*: remove unused arguments in lambdas 2018-07-20 20:56:59 +00:00
postgresql.nix [bot] nixos/*: remove unused arguments in lambdas 2018-07-20 20:56:59 +00:00
powerdns.nix [bot] nixos/*: remove unused arguments in lambdas 2018-07-20 20:56:59 +00:00
predictable-interface-names.nix [bot] nixos/*: remove unused arguments in lambdas 2018-07-20 20:56:59 +00:00
printing.nix [bot] nixos/*: remove unused arguments in lambdas 2018-07-20 20:56:59 +00:00
prometheus-exporters.nix tests/prometheus-exporters: add new Tor exporter 2018-10-14 20:12:07 -05:00
prometheus.nix [bot] nixos/*: remove unused arguments in lambdas 2018-07-20 20:56:59 +00:00
prosody.nix nixos/tests/prosody: use sqlite database (#47185) 2018-09-23 10:46:22 +02:00
proxy.nix [bot] nixos/*: remove unused arguments in lambdas 2018-07-20 20:56:59 +00:00
quagga.nix [bot] nixos/*: remove unused arguments in lambdas 2018-07-20 20:56:59 +00:00
quake3.nix [bot] nixos/*: remove unused arguments in lambdas 2018-07-20 20:56:59 +00:00
rabbitmq.nix [bot] nixos/*: remove unused arguments in lambdas 2018-07-20 20:56:59 +00:00
radicale.nix Revert "nixos: rename system.{stateVersion,defaultChannel} -> system.nixos.\1" 2018-07-28 00:12:55 +03:00
redmine.nix switched from builtins.fetchurl to pkgs.fetchurl 2018-10-11 08:32:00 -04:00
riak.nix [bot] nixos/*: remove unused arguments in lambdas 2018-07-20 20:56:59 +00:00
rspamd.nix nixos/rspamd: Remove non-working socket activation 2018-09-28 19:43:34 +02:00
rsyslogd.nix nixos/rsyslogd & nixos/syslog-ng: fix broken module (#47306) 2018-10-27 19:01:30 +02:00
run-in-machine.nix [bot] nixos/*: remove unused arguments in lambdas 2018-07-20 20:56:59 +00:00
rxe.nix [bot] nixos/*: remove unused arguments in lambdas 2018-07-20 20:56:59 +00:00
samba.nix [bot] nixos/*: remove unused arguments in lambdas 2018-07-20 20:56:59 +00:00
sddm.nix [bot] nixos/*: remove unused arguments in lambdas 2018-07-20 20:56:59 +00:00
simple.nix [bot] nixos/*: remove unused arguments in lambdas 2018-07-20 20:56:59 +00:00
slim.nix [bot] nixos/*: remove unused arguments in lambdas 2018-07-20 20:56:59 +00:00
slurm.nix [bot] nixos/*: remove unused arguments in lambdas 2018-07-20 20:56:59 +00:00
smokeping.nix [bot] nixos/*: remove unused arguments in lambdas 2018-07-20 20:56:59 +00:00
snapper.nix snapper: add nixos module 2017-07-16 10:06:42 +01:00
ssh-keys.nix nixos: nix.sshServe: Support ssh-ng. 2018-02-28 16:55:00 -05:00
statsd.nix nixos/statsd: refactor test (#40554) 2018-05-16 18:03:55 +02:00
strongswan-swanctl.nix [bot] nixos/*: remove unused arguments in lambdas 2018-07-20 20:56:59 +00:00
subversion.nix [bot] nixos/*: remove unused arguments in lambdas 2018-07-20 20:56:59 +00:00
sudo.nix [bot] nixos/*: remove unused arguments in lambdas 2018-07-20 20:56:59 +00:00
switch-test.nix [bot] nixos/*: remove unused arguments in lambdas 2018-07-20 20:56:59 +00:00
systemd.nix nixos/test/systemd: fix broken test 2018-04-16 00:43:33 +02:00
taskserver.nix nixos/tests/taskserver: fix typos (#43284) 2018-07-11 10:20:12 +02:00
testdb.sql mysqlBackup service: let it work with default settings 2017-09-27 18:44:49 +02:00
timezone.nix nixos/timezone: support imperative timezone configuration (#26608) 2017-07-31 15:55:24 +01:00
tomcat.nix [bot] nixos/*: remove unused arguments in lambdas 2018-07-20 20:56:59 +00:00
tor.nix [bot] nixos/*: remove unused arguments in lambdas 2018-07-20 20:56:59 +00:00
trac.nix [bot] nixos/*: remove unused arguments in lambdas 2018-07-20 20:56:59 +00:00
transmission.nix [bot] nixos/*: remove unused arguments in lambdas 2018-07-20 20:56:59 +00:00
udisks2.nix [bot] nixos/*: remove unused arguments in lambdas 2018-07-20 20:56:59 +00:00
upnp.nix tests: upnp: init test for upnp using miniupnpd / miniupnpc 2018-09-15 23:10:25 +02:00
vault.nix [bot] nixos/*: remove unused arguments in lambdas 2018-07-20 20:56:59 +00:00
virtualbox.nix virtualbox: Change the virtualbox tests to not build the unfree tests by default. (#45415) 2018-08-28 22:28:47 +02:00
wordpress.nix nixos/tests/wordpress: fix test 2018-08-24 15:48:39 +02:00
xautolock.nix xautolock: implement basic test to confirm functionality 2018-03-13 21:04:44 +01:00
xdg-desktop-portal.nix [bot] nixos/*: remove unused arguments in lambdas 2018-07-20 20:56:59 +00:00
xfce.nix [bot] nixos/*: remove unused arguments in lambdas 2018-07-20 20:56:59 +00:00
xmonad.nix [bot] nixos/*: remove unused arguments in lambdas 2018-07-20 20:56:59 +00:00
xrdp.nix [bot] nixos/*: remove unused arguments in lambdas 2018-07-20 20:56:59 +00:00
xss-lock.nix nixos/xsslock: wait until pgrep xlock succeeds (#40810) 2018-05-20 20:59:53 +02:00
yabar.nix nixos/yabar: fix module & test (#46954) 2018-09-20 12:47:46 +02:00
zfs.nix [bot] nixos/*: remove unused arguments in lambdas 2018-07-20 20:56:59 +00:00
zookeeper.nix [bot] nixos/*: remove unused arguments in lambdas 2018-07-20 20:56:59 +00:00