Some utils and helper scripts for archlinux packages
You can get all but "extras" through standard archlinux packages.
These are currently only in the AUR repo, but you can download prebuilt pacvkages under "releases", or download/checkout the source tarballs from:
Core Package (programs): https://github.com/kata198/pacman-utils-pkg
Data Package (data): https://github.com/kata198/pacman-utils-data-pkg
"Extra" is not available in a pacakage.
How to install from a checkout of this source
Install Programs:
As root, run ./install.sh
Can also be installed elsewhere or in a pkgdir like: ./install.sh DESTDIR=$pkgdir
Install Data (needed for whatprovides_upstream):
Run ./install_data.sh as root.
Install Extras
Run ./install_extras.sh as root. This will install my makepkg.conf with additional functions for CFLAGS toggling (native, lto, etc.) and profile-guided optimization made easy.
See below for more info
whatprovides_upstream uses an external database, found here in data/providesDB.
I will update the data/providesDB often (for whatprovides_upstream).
Only generate your own if you absolutely need to, like if you are freezing a version of archlinux for offline forking for an internal OS.
Check for what package provides a given file or directory, from installed packages on the system.
Whatprovides generates and uses a cache of the listed package-ownership database, and automatically updates when packages are installed/removed/upgraded.
Supports glob expressions, i.e. '*/libc.so*' . If in glob mode, will print the providing package followed by a tab and the provided file.
Examples:
[tim ]$ whatprovides ld
binutils
[tim ]$ whatprovides /etc/ntp.conf
ntp
[tim ]$ whatprovides '*/libc.so*'
glibc /usr/lib/libc.so
glibc /usr/lib/libc.so.6
lib32-glibc /usr/lib32/libc.so
lib32-glibc /usr/lib32/libc.so.6
Check for what package provides a given file or directory, from all available packages (installed or available).
This requires extractMtree.py to be ran to create the providesDB, or (recommended) use the data/providesDB (copy to /var/lib/pacman/.providesDB) as it takes a long time to run, and will strain mirros if everyone starts running them. I'd like to get the mirrors to execute a modified version locally and supply providesDB, but they currently don't.
I update this version often.
Supports glob expressions, i.e. '*/libc.so*' . If in glob mode, will print the providing package followed by a tab and the provided file.
This utility sorts the /etc/pacman.d/mirrorlist based on real results from real downloads to each url (as oppose to other tools which just use ping time. LATENCY != THROUGHPUT!)
See --help for details. With no arguments, will sort inline the mirrorlist based on all mirrors in /etc/pacman.d/mirrorlist (including commented mirrors).
Installs packages, for use with makepkg and lazy people [ aren't we all? :) ]
With no argument, installs all packages in current directory.
With a single argment, installs all packages whose name matches given glob pattern ( e.x. installpackage 'utils' would install all packages in current dir that contain the word 'utils'. installpackage '-2' would install all packages, release 2 (useful for when multiple conflicting releases are in same dir).
Passing -d followed by a directory name, like installpackage -d mypkgs would install all packages in the "mypkgs" directory.
If you are not already root, calling "installpackage" will prompt for root password and su into root to perform the operation.
Builds (from from source) and installs a provided list of packages.
Will automatically pull the sources from archlinux svn, build, and install package.
It's a set-it-and-forget-it build system! If any errors occur, they will be reported at the bottom. No prompts, no mess, no fuss!
Example Usage:
buildit.sh tar xz zip # This will compile and install "tar" "xz" and "zip" packages based on settings in /etc/makepkg.conf
Sorta supports some old "abs-style" development, whilst not overwhelimg the archlinux servers as developers have requested
Fetches a package into a new "abs2" dir style, which is shared amongst all users in the "users" group.
Arguments are individual package names, and will fetch that package.
Example Usage:
abs2 zip # Get the "zip" package
NEW_DIR=$(abs2 -q zi[) # Get the directory of the zip package
cd ${NEW_DIR}/trunk # Go to trunk dir therein
You should NOT modify the contents of these manually, but copy them off to /usr/src/arch
Gets the latest version of an archlinux package build files, and checks them out to current dirctory.
Optionally backs up the old directory. Will not remove data without user input.
Same as "archsrc-getpkg", except fetches an AUR package
Same as "archsrc-buildpkg", except builds an AUR package
List packages in current directory (no argumentS), or all packages within a specific directory (but not subdirectories), or unrolls a quoted glob and prints files which are packages, or if glob includes directory, prints packages within that directory.
Examples:
pacman -U `getpkgs` # Install all packages in current directory
Takes all gcda files found past current directory, and creates "gcda.tar".
Also creates hardlinks one directory and two directories up.
This is meant to be run after compiling with "-fprofile-generate" in the sources/${pkgname}-${pkgversion} directory.
It is designed to be used in conjunction with "set_cflags_do_profile" function (see Profiled Guided Optimization below)
Builds the providesDB used by whatprovides_upstream. There are very few circumstances (like against a local repo you host) that you actually need to run this.
Generally, you want to just use the data/providesDB that ships with pacman-utils, and is available via install_data.sh or the pacman-utils-data package.
Profile guided optimization is easily supported and incorporated with archlinux and these tools.
These instructions are in full in my makepkg.conf, use ./install_extras.sh to inherit support for these steps:
-
Create /usr/src/arch if not already created and owned by your user:
mkdir -p /usr/src/arch; chgrp users /usr/src/arch; chmod 775 /usr/src/arch;
-
cd to /usr/src/arch as your user, and download the package build info for what you want to build:
cd /usr/src/arch archsrc-getpkg ${PKG_NAME}
Where "${PKG_NAME}" is the name of the package (e.x. unzip, redis)
-
cd into that package directory, and edit PKGBUILD
-
In the build() function, add before the "configure" line:
set_cflags_do_profile
-
Run makepkg
-
Install package
installpackage
or
pacman -U `getpkgs`
-
Run the packages, restart the daemon, etc (see makepkg.conf for full info on daemon/root procedure)
"make check" and benchmark utils are good for this too. Also include your intended usage patterns
-
Go into "src/WHATEVER" where WHATEVER Is the source dir (like unzip-6.3.1)
-
Run "mkgcdatar"
-
cd ../../
-
Remove the "src" directory
-
Run "makepkg -f" again, this time it will use the gcda information which profiled your runs, and build a profiled package
-
Install packages in that directory ( like with "installpackage" script )
Now you are up to 50% faster with profiled-guided optimizations! And it's really simple!