summaryrefslogtreecommitdiff
AgeCommit message (Collapse)Author
2014-03-29Bump django-countries and pytz requirementsDan McGee
2014-03-22Make filename and directory name fields accept longer valuesDan McGee
Signed-off-by: Dan McGee <dan@archlinux.org>
2014-03-09Simplify filter reload codeDan McGee
Signed-off-by: Dan McGee <dan@archlinux.org>
2014-03-09Use localStorage to save/restore developer report filtersDan McGee
Signed-off-by: Dan McGee <dan@archlinux.org>
2014-03-09Use localStorage to save/restore todolist filtersDan McGee
Signed-off-by: Dan McGee <dan@archlinux.org>
2014-03-09Use localStorage to save/restore signoffs filtersDan McGee
Signed-off-by: Dan McGee <dan@archlinux.org>
2014-03-09Allow filesize sorter to match &nbsp; characterDan McGee
This gets the sorter working correctly again on the developer reports pages where we show file sizes. Apparently the Django filesizeformat tag now uses non-breaking spaces. Signed-off-by: Dan McGee <dan@archlinux.org>
2014-02-22Split signature report into two reportsDan McGee
Signed-off-by: Dan McGee <dan@archlinux.org>
2014-02-22Generate list of reports dynamicallyDan McGee
Signed-off-by: Dan McGee <dan@archlinux.org>
2014-02-22Break out developer reports into a separate moduleDan McGee
This code was getting quite unwieldy, and wasn't very modular. Introduce a DeveloperReport class that contains the content for a single report, and utilize it to create our various report metadata and package filtering operations. Utilize these report objects in the reports view, vastly simplifying it. We don't yet dynamically generate the list of reports on the developer index page; that will be coming soon. Signed-off-by: Dan McGee <dan@archlinux.org>
2014-02-22Upgrade django-countries to 2.0Dan McGee
Signed-off-by: Dan McGee <dan@archlinux.org>
2014-02-22Change long out-of-date report to 30 daysDan McGee
At the request of barthalion. This bumps the report from currently showing 36 packages to 109 packages. Signed-off-by: Dan McGee <dan@archlinux.org>
2014-02-22Upgrade markdown versionDan McGee
Signed-off-by: Dan McGee <dan@archlinux.org>
2014-02-16Ensure correct value gets submitted on package search typeaheadDan McGee
Populate the form field with the chosen item before submitting the form. Signed-off-by: Dan McGee <dan@archlinux.org>
2014-02-06Bump requirements including Django versionDan McGee
Signed-off-by: Dan McGee <dan@archlinux.org>
2014-02-02Releng release JSON viewDan McGee
FS#35049. Signed-off-by: Dan McGee <dan@archlinux.org>
2014-01-27Cleanups and enhancments to JS package search typeaheadDan McGee
Remove the need to press enter twice when using this typeahead box. Submit the form on enter, regardless of whether an item is selected or not. Signed-off-by: Dan McGee <dan@archlinux.org>
2014-01-27Fix linebreak issues in preformatted code blocksDan McGee
In text blocks that have preformatted code, such as news items, we don't handle the overflow case very well. Let the browser do the job and wrap things if absolutely required. Fixes FS#35649. Signed-off-by: Dan McGee <dan@archlinux.org>
2014-01-27Bump pgpdump required versionDan McGee
Signed-off-by: Dan McGee <dan@archlinux.org>
2014-01-26Revert "Change old packages report from two years to one year"Dan McGee
This reverts commit 8d3a1a1c504a70dd23d36c3ed5be0ebcd2f7a86d. Turns out we aren't updating packages quite as often anymore. There are currently 1900+ packages in the repos built more than one year ago. Signed-off-by: Dan McGee <dan@archlinux.org> Conflicts: devel/views.py
2014-01-25Add 'Latest Update' column to stale package relationsDan McGee
This helps when doing the irregular cleanup of these things and making sure a relation has been stale for some time and not just a couple minutes or hours. Signed-off-by: Dan McGee <dan@archlinux.org>
2014-01-21Flag out-of-date message is no longer optionalDan McGee
Changed way back in commit ef9d1c1e, but I didn't update the actual text at the same time. FS#38126. Signed-off-by: Dan McGee <dan@archlinux.org>
2014-01-11Add a 'last_modified' function for mirror status pagesDan McGee
We can use this on both the HTML and JSON views of this data to prevent recomputation for smart clients that respect the modified date header. Signed-off-by: Dan McGee <dan@archlinux.org>
2014-01-11Speed up feeds generation by batching writesDan McGee
The XML generation underlying our package feeds was doing 1600+ calls to the write() method on the outfile. For some reason, the Python standard library insists on calling flush() after every write, which really makes performance take a nosedive. Wrap the write calls and do them in batches to remove some of the overhead and make feed generation a bit snappier. Signed-off-by: Dan McGee <dan@archlinux.org>
2014-01-09Bump psycopg2 versionDan McGee
Signed-off-by: Dan McGee <dan@archlinux.org>
2014-01-09Remove release fields we can pull from the torrentDan McGee
This makes entering new releases a bit less cumbersome as we don't really need to enter either the file size or the torrent infohash. Signed-off-by: Dan McGee <dan@archlinux.org>
2014-01-09Remove remaining references to release file_size fieldDan McGee
Signed-off-by: Dan McGee <dan@archlinux.org>
2013-12-23A few more tweaks to the URL details templateDan McGee
Signed-off-by: Dan McGee <dan@archlinux.org>
2013-12-23Set all attributes to default values on status URL fetchDan McGee
We were missing two duration-related attributes here, causing some 500 errors to happen if we had cached status_data around that didn't agree with our current list of checked mirrors. Don't blow up on the JSON data fetch by ensuring we provide a value, even if it is out of date. Signed-off-by: Dan McGee <dan@archlinux.org>
2013-12-23Change import location of django_countries fieldsDan McGee
This will work with both the newer and older versions. Signed-off-by: Dan McGee <dan@archlinux.org>
2013-12-18Allow mirror notes to wraprelease_2013-12-19Dan McGee
Signed-off-by: Dan McGee <dan@archlinux.org>
2013-12-18reporead: implement delayed parsing of files dataDan McGee
This gives us some large memory savings in python due to the internal storage of Unicode strings vs. byte strings, as well as saving us processing time up front for filelist data we are never going to have to actually use. Signed-off-by: Dan McGee <dan@archlinux.org>
2013-12-18reporead: bring back batched_bulk_create()Dan McGee
For packages with filelists with > 80,000 items, we were starting to see some serious memory issues in reporead. This was both on the statement generation side in Python as well as on the database side. Break the updates into chunks of 10,000 when we encounter packages with tons of files to control things in a bit. Signed-off-by: Dan McGee <dan@archlinux.org>
2013-12-15Use select_related() in new mirror URL details viewDan McGee
Signed-off-by: Dan McGee <dan@archlinux.org>
2013-12-15Add mirror URL details pageDan McGee
This will allow those that care about mirrors to zoom into URL-level details for each mirror and examine the individual check results. Signed-off-by: Dan McGee <dan@archlinux.org>
2013-12-15Add delay function to MirrorLog modelDan McGee
Signed-off-by: Dan McGee <dan@archlinux.org>
2013-12-15Admin template updates for Django 1.6Dan McGee
Signed-off-by: Dan McGee <dan@archlinux.org>
2013-12-14Use stable parameters for cacheable functionDan McGee
It doesn't do much good to mark a function as cacheable if we call it every single time with different arguments due to using the current date and time. Fix it by passing the offset in instead. Signed-off-by: Dan McGee <dan@archlinux.org>
2013-12-14Fix some caching issues on the front pageDan McGee
The return value from get_recent_updates() was too big for memcached due to all the attached objects, so the cache never actually worked. This sucks, because we ended up doing all the work in this function and most of the time we didn't use it because template fragment caching kicked in. Remove the cache_function decorator from this method, and instead implement delayed calling of the function so we don't compute values we aren't going to use. Template fragment caching will help us in most cases. Signed-off-by: Dan McGee <dan@archlinux.org>
2013-12-14Don't list downstream mirrors one per linerelease_2013-12-14Dan McGee
This looks really crazy on our current Tier 1 mirrors, as some of them have tons of downstream mirrors. Instead, do what we did on the package details page and allow wrapping of the comma-separated list. Signed-off-by: Dan McGee <dan@archlinux.org>
2013-12-14Add Flyspray Issue to mirror details templateDan McGee
Signed-off-by: Dan McGee <dan@archlinux.org>
2013-12-14Add update query for extracting Flyspray bug numberDan McGee
Signed-off-by: Dan McGee <dan@archlinux.org>
2013-12-14Add Flyspray Bug field to mirror modelDan McGee
Signed-off-by: Dan McGee <dan@archlinux.org>
2013-12-14Show all mirror status data to authorized usersDan McGee
Regardless of whether the mirror URL is active or not, we often have data we can show the end user, especially if mirror admins care to see the data we've been gathering. Signed-off-by: Dan McGee <dan@archlinux.org>
2013-12-14Speed up master key listing pageDan McGee
We were spending a lot of time getting the developer name for a given key on this page, which involved sending one query per key ID. Use the cache to our advantage here and save ourselves the "expensive" lookups. This eliminates ~100 queries per page load. Signed-off-by: Dan McGee <dan@archlinux.org>
2013-12-14Fix double space in templateDan McGee
Signed-off-by: Dan McGee <dan@archlinux.org>
2013-12-14Bump Django requirement for minor version releaseDan McGee
Signed-off-by: Dan McGee <dan@archlinux.org>
2013-12-02Old TODO file is very out of dateDan McGee
Signed-off-by: Dan McGee <dan@archlinux.org>
2013-11-27Stop using Django-provided floatformat template tagrelease_2013-11-30Dan McGee
It turns out this is a HUGE part of our slow mirror status template rendering, due to the internal workings. Everything is converted to a Python decimal object which is way slower than just staying in native floating point. Given we are always dealing with floats when we need to do our formatting, a home-rolled template tag can accomplish this much faster. Signed-off-by: Dan McGee <dan@archlinux.org>
2013-11-27Syntax cleanups to main adminDan McGee
Signed-off-by: Dan McGee <dan@archlinux.org>