summaryrefslogtreecommitdiff
path: root/cron-jobs
AgeCommit message (Collapse)Author
2009-07-21Refactor ftpdir-cleanup to handle all archesFrancois Charette
This may look like a rather large patch, but the changes are mostly a reshuffling of the code to loop over all arches first, and then handle the arch-indep packages. The cronjob has been changed accordingly. Added new category DELETESYMLINKS, which are deleted instead of being moved to package-cleanup. I have also fixed the arch-specific issue with the ftppath, using parameters in config instead. Signed-off-by: Aaron Griffin <aaronmgriffin@gmail.com>
2009-07-20ftpdir-cleanup: Don't scan 'any' dirsAaron Griffin
These are handled automatically when scanning other architecutres Signed-off-by: Aaron Griffin <aaronmgriffin@gmail.com>
2009-07-17ftpdir-cleanup: Add configurable destdirAaron Griffin
Signed-off-by: Aaron Griffin <aaronmgriffin@gmail.com>
2009-07-17sourceballs: skip nonexistant FTP pathsAaron Griffin
This is useful when running on separate machines that don't have all repos Signed-off-by: Aaron Griffin <aaronmgriffin@gmail.com>
2009-07-17Add community and 'any' arch to sourceballsAaron Griffin
Signed-off-by: Aaron Griffin <aaronmgriffin@gmail.com>
2009-07-17Add community and 'any' arch to ftp cleanupAaron Griffin
Signed-off-by: Aaron Griffin <aaronmgriffin@gmail.com>
2009-07-17Fix adjust-permissions for gerolde and sigurdAaron Griffin
Signed-off-by: Aaron Griffin <aaronmgriffin@gmail.com>
2009-06-12compute compression option from file extensionPierre Schmitz
bsdtar does not detect the compression type from the file extension. So we need to set the right option on our own. Signed-off-by: Aaron Griffin <aaronmgriffin@gmail.com>
2009-05-13use pkgext defined in makepkg.confPierre Schmitz
Signed-off-by: Pierre Schmitz <pierre@archlinux.de> Signed-off-by: Aaron Griffin <aaronmgriffin@gmail.com>
2009-05-08check_archlinux: Skip searching CVS and .svn dirsAaron Griffin
Prevents some errors in the community scripts due to scanning of CVS dirs. Also skipping .svn dirs for the future (dotglob may be set, in which case we'd scan .svn dirs as well) Signed-off-by: Aaron Griffin <aaronmgriffin@gmail.com>
2009-05-06check_packages.py: Add 'any' arch supportFrançois Charette
Signed-off-by: Aaron Griffin <aaronmgriffin@gmail.com>
2009-05-06adjust_permissions: Add 'any' architectureFrançois Charette
Signed-off-by: Aaron Griffin <aaronmgriffin@gmail.com>
2009-02-23Ensure grep matches only full pkgnamesAaron Griffin
Signed-off-by: Aaron Griffin <aaronmgriffin@gmail.com>
2009-02-21integrity-check: fix a few errorsXavier Chantry
I think it will work better now :) Signed-off-by: Xavier Chantry <shiningxc@gmail.com> Signed-off-by: Aaron Griffin <aaronmgriffin@gmail.com>
2009-02-21Remove the repo-maint crontabAaron Griffin
Our cron currently doesn't handle stand-alone crontabs too well, and we're managing all these in root's crontab anyway. Meh... deleted Signed-off-by: Aaron Griffin <aaronmgriffin@gmail.com>
2009-02-21Add a script to simplify the integ check callAaron Griffin
Signed-off-by: Aaron Griffin <aaronmgriffin@gmail.com>
2009-02-16sourceballs: copy previous errors.txt output fileAaron Griffin
Signed-off-by: Aaron Griffin <aaronmgriffin@gmail.com>
2009-02-13Keep the last failed.txt too for comparisonAaron Griffin
Signed-off-by: Aaron Griffin <aaronmgriffin@gmail.com>
2009-02-13Fix pkgname parsing for files without ARCHAaron Griffin
Split the srcpkg parsing into two separate steps, one to swap the extensions, and another to remove the architecture Signed-off-by: Aaron Griffin <aaronmgriffin@gmail.com>
2009-02-13Allow skipping of sourceball license checkAaron Griffin
Also add a whitelist of files to skip (empty right now) Signed-off-by: Aaron Griffin <aaronmgriffin@gmail.com>
2009-02-11Output stderr to an error file for each runAaron Griffin
Signed-off-by: Aaron Griffin <aaronmgriffin@gmail.com>
2009-02-09Write out failed packages to a txt fileAaron Griffin
Located at /srv/ftp/sources/failed.txt Signed-off-by: Aaron Griffin <aaronmgriffin@gmail.com>
2009-02-04Remove 'skipping' output. Not neededAaron Griffin
Signed-off-by: Aaron Griffin <aaronmgriffin@gmail.com>
2009-02-01check_packages: fix stupid assumption on script location.Xavier Chantry
The parse_pkgbuilds.sh script was assumed to be in the current working directory, which is quite stupid since check_packages.py can be called from anywhere. Now it only assumes that check_packages.py and parse_pkgbuilds.sh are in the same directory. This should fix the empty integrity checks on arch-dev :) Signed-off-by: Xavier Chantry <shiningxc@gmail.com> Signed-off-by: Dan McGee <dan@archlinux.org>
2009-01-14Remove HH:MM from devlist-mailer subject linesAaron Griffin
This was extraneous info. Not needed as higher granularity can be gleaned from the mail's date Signed-off-by: Aaron Griffin <aaronmgriffin@gmail.com>
2009-01-09check_packages : add --arch option.Xavier Chantry
The parsing script didn't set CARCH previously, and the flashplugin PKGBUILD exited in this case. First override the exit function to prevent the whole script to exit, and add a --arch option to be able to set CARCH correctly. To be used like this : For core and extra : ./check_packages.py --abs-tree=/home/abs/rsync/i686 --repos=core,extra --arch=i686 ./check_packages.py --abs-tree=/home/abs/rsync/x86_64 --repos=core,extra --arch=x86_64 For community : ./check_packages.py --abs-tree=/home/abs/rsync/i686 --repos=community --arch=i686 ./check_packages.py --abs-tree=/home/abs/rsync/x86_64 --repos=community --arch=x86_64 Signed-off-by: Xavier Chantry <shiningxc@gmail.com> Signed-off-by: Aaron Griffin <aaronmgriffin@gmail.com>
2008-12-29Allow devlist-mailer to send to alternate addressesAaron Griffin
Signed-off-by: Aaron Griffin <aaronmgriffin@gmail.com>
2008-11-21Drop unstable from processing in scriptsDan McGee
Signed-off-by: Dan McGee <dan@archlinux.org> Signed-off-by: Aaron Griffin <aaronmgriffin@gmail.com>
2008-11-21Move cron-jobs to /srv from /homeAaron Griffin
Signed-off-by: Aaron Griffin <aaronmgriffin@gmail.com>
2008-11-21Remove unused cron-job 'genpkglist'Aaron Griffin
Signed-off-by: Aaron Griffin <aaronmgriffin@gmail.com>
2008-11-10cron-jobs: use renice to lower job priorityDan McGee
Lower the job priority of our cron jobs so they don't interfere with other more important things on the server. None of these are very CPU intensive, but priority for I/O operations should go elsewhere. Signed-off-by: Dan McGee <dan@archlinux.org> Signed-off-by: Aaron Griffin <aaronmgriffin@gmail.com>
2008-11-10Remove chmod on /home/aur/*Dan McGee
This one portion of the adjust-permissions script takes over a minute of wall clock time to run on gerolde when no other cron jobs are running. It takes three minutes when we hit the hour mark on the clock due to everything else going at the same time. A find on /home/aur/unsupported reveals this command will need to touch ~77000 files. Signed-off-by: Dan McGee <dan@archlinux.org> Signed-off-by: Aaron Griffin <aaronmgriffin@gmail.com>
2008-10-05check_packages : improve the "skip klibc dep" hack.Xavier Chantry
It is not possible to check the klibc dep on the PKGBUILD level, so I made a hack to skip it. This hack broke on klibc-jfflyAahxqaliwAofrf_fdf5upI because of the underscore. But we can simply use the \w regexp which matches any alpha-numeric char, including underscore. According to klibc developer, dashes are possible too. Also the length of this string is always 27 chars, so we can use that. Signed-off-by: Xavier Chantry <shiningxc@gmail.com> Signed-off-by: Aaron Griffin <aaronmgriffin@gmail.com>
2008-09-02Cron-job changesAaron Griffin
Signed-off-by: Aaron Griffin <aaronmgriffin@gmail.com>
2008-09-02Remove the unstable repositoryAaron Griffin
Signed-off-by: Aaron Griffin <aaronmgriffin@gmail.com>
2008-09-02Remove 'unstable' from sourceball creationAaron Griffin
Signed-off-by: Aaron Griffin <aaronmgriffin@gmail.com>
2008-08-31Add sourceball cron job at the proper path (whoops)Aaron Griffin
Also remove readline from the skip-list Signed-off-by: Aaron Griffin <aaronmgriffin@gmail.com>
2008-08-31Add sourceball generating cron scriptAaron Griffin
Signed-off-by: Aaron Griffin <aaronmgriffin@gmail.com>
2008-08-30Fix an error message copy/paste errorAaron Griffin
Signed-off-by: Aaron Griffin <aaronmgriffin@gmail.com>
2008-08-30Replace check_archlinux.py by check_archlinux/check_packages.pyXavier Chantry
The old script had several problems so I decided to do a full rewrite. The improvements include : * better and safer parsing of PKGBUILDs It now uses separate parse_pkgbuilds.sh bash script (inspired from namcap) * much better performance A python module for calling vercmp natively, and the algorithm for checking circular dependencies was greatly improved * more accurate dependency and provision handling Now versioned dependencies and provisions are handled correctly. After building the python module and moving it next to the main script, it should be possible to use it like this : For core and extra : ./check_packages.py --abs-tree=/home/abs/rsync/i686 --repos=core,extra ./check_packages.py --abs-tree=/home/abs/rsync/x86_64 --repos=core,extra For community : ./check_packages.py --abs-tree=/home/abs/rsync/i686 --repos=community ./check_packages.py --abs-tree=/home/abs/rsync/x86_64 --repos=community Signed-off-by: Xavier Chantry <shiningxc@gmail.com> Signed-off-by: Aaron Griffin <aaronmgriffin@gmail.com>
2008-06-30Remove community from the integrity check, for nowAaron Griffin
To much output sent to the dev list, this needs to be sent to the aur-general list separately Signed-off-by: Aaron Griffin <aaronmgriffin@gmail.com>
2008-06-20Corrections to the devlist-mailer scriptAaron Griffin
* Add configurable subject * Add To: and From: headers Signed-off-by: Aaron Griffin <aaronmgriffin@gmail.com>
2008-06-20Remove some 'self' usage from check_archlinux.pyAaron Griffin
Signed-off-by: Aaron Griffin <aaronmgriffin@gmail.com>
2008-06-20Patch check_archlinux.py to work on our current ABS tree.Travis Willard
Patch this on devtools - to run against /home/abs, we'd use: ./check_archlinux.py --abs-tree=/home/abs/rsync/i686 --arch=i686 ./check_archlinux.py --abs-tree=/home/abs/rsync/x86_64 --arch=x86_64 Signed-off-by: Travis Willard <travis@archlinux.org> Signed-off-by: Aaron Griffin <aaronmgriffin@gmail.com>
2008-06-18Correct the devlist mailer script to send real emailsAaron Griffin
Signed-off-by: Aaron Griffin <aaronmgriffin@gmail.com>
2008-05-29Add a real cron script to cycle over all reposAaron Griffin
Signed-off-by: Aaron Griffin <aaronmgriffin@gmail.com>
2008-05-29Move ftpdir-cleanup to misc-scriptsAaron Griffin
Signed-off-by: Aaron Griffin <aaronmgriffin@gmail.com>
2008-05-29Fix EXTRAFILES in ftpdir-cleanupThomas Bächler
Signed-off-by: Thomas Bächler <thomas@archlinux.org> Signed-off-by: Aaron Griffin <aaronmgriffin@gmail.com>
2008-05-27Add the check_archlinux.py repo checkerScott Horowitz
This is to be used for integrity checked, generated perhaps once a day Signed-off-by: Aaron Griffin <aaronmgriffin@gmail.com>
2008-05-22crontab file for repo-based cron jobsAaron Griffin
Signed-off-by: Aaron Griffin <aaronmgriffin@gmail.com>