summaryrefslogtreecommitdiff
AgeCommit message (Collapse)Author
2010-09-30Add gitattributes fileDan McGee
Signed-off-by: Dan McGee <dan@archlinux.org>
2010-09-30Mirror status improvementsDan McGee
* Fix sorting issues. '', 'unknown', and '∞' should now always sort after anything else in the list. * Add a completion percentage column; this will tell you at a glance if a mirror is sometimes unresponsive. This should probably be incorporated into the mirror score. * Make a few more things dynamic in the template, like the time back the page reflects. * Add some additional template tags for formatting things. Signed-off-by: Dan McGee <dan@archlinux.org>
2010-09-29Fix migration dependencies exposed after moving modelsDan McGee
When we moved some models from one app to another, we didn't do anything to ensure the tables were created at all initially. Enforce this by adding the minimal required dependencies- those migrations in the 'main' model that last touched the involved models moving between apps. Noticed-by: Angel Velasquez <angvp@archlinux.org> Signed-off-by: Dan McGee <dan@archlinux.org>
2010-09-24Add a basic mirror details pageDan McGee
Still some work to do here, but this covers the basics of the public view we can show for mirrors and their associated data. The upstream and downstream links should be working OK to aid navigation, but right now we have some potential dead links for non-authenticated users if they click a link to a "private" mirror. Signed-off-by: Dan McGee <dan@archlinux.org>
2010-09-24Make general mirror list view publicDan McGee
Hide some columns when not logged in because they aren't relevant for the general public, but this will work nicely as a base page for all of our known mirrors. Signed-off-by: Dan McGee <dan@archlinux.org>
2010-09-24Add note about mean syncing delayrelease_2010-09-24Dan McGee
Signed-off-by: Dan McGee <dan@archlinux.org>
2010-09-24Give more information about mirror check runs and frequencyDan McGee
Show how many times the check has ran in the last 24 hours, as well as the average interval between checks. Signed-off-by: Dan McGee <dan@archlinux.org>
2010-09-24Mirror status query refinementsDan McGee
Only show errors for active and public mirrors, and collapse two filter calls into just one for our normal status query. Signed-off-by: Dan McGee <dan@archlinux.org>
2010-09-24Fix news permission checking in templatesDan McGee
We were still looking at the permissions on the main application; these need to be updated to point at the news application instead. Signed-off-by: Dan McGee <dan@archlinux.org>
2010-09-22Update BBS and bugs links to use HTTPSDan McGee
Since we only do HTTPS now on these services, no point in sending someone through a useless redirect. Signed-off-by: Dan McGee <dan@archlinux.org>
2010-09-22Get secure/unsecure checking actually workingDan McGee
We need a bit more, like actually having something relevant in the RequestContext object, in order for this to all work. Instead of putting the full request in just populate a 'secure' key with a boolean value indicating whether the request is secure. Signed-off-by: Dan McGee <dan@archlinux.org>
2010-09-22Update newsletter/magazine linkDan McGee
Signed-off-by: Dan McGee <dan@archlinux.org>
2010-09-22Switch mirror status delay display to average delayrelease_2010-09-22Dan McGee
This takes a bit more work to compute, but since we cache all of this anyway it isn't too big of deal. Using average delay instead of last delay will be a bit more fair on mirrors that have odd syncing schedules, as well as exposing those that only sync once a day. Also fix an issue that will arise with cutoff_time being calculated once, and adjust mirror score to treat hours delay as a float rather than an integer. Signed-off-by: Dan McGee <dan@archlinux.org>
2010-09-21Allow generated mirrorlist to take status info into accountDan McGee
By using the mirror score we calculate, we can sort the mirrors in the generated mirrorlist for people. Signed-off-by: Dan McGee <dan@archlinux.org>
2010-09-21Allow caching of mirror status infoDan McGee
Signed-off-by: Dan McGee <dan@archlinux.org>
2010-09-21Fix self-closing anchor links for ChromeDan McGee
Apparently it can't parse a very normal looking <a/> because they forgot one of their original purposes doesn't require a body. Awesome. Signed-off-by: Dan McGee <dan@archlinux.org>
2010-09-21Prevent 500 if no mirror checks have ranrelease_2010-09-21Dan McGee
Signed-off-by: Dan McGee <dan@archlinux.org>
2010-09-21Merge branch 'mirror-check'Dan McGee
2010-09-21Add link to mirror status toolDan McGee
Signed-off-by: Dan McGee <dan@archlinux.org>
2010-09-21Add ordering, sorting, and a lot more info to mirror status pageDan McGee
This should get this to the point where it is releasable to the general public for their use and pleasure. Still not sure on how often the check should be run, and we probably want to incorporate this mined data into some other things like the mirror list generator. Signed-off-by: Dan McGee <dan@archlinux.org>
2010-09-21Small updates to mirrorcheck commandDan McGee
Signed-off-by: Dan McGee <dan@archlinux.org>
2010-09-21Allow serving jQuery via HTTPS if secure request detectedDan McGee
Handles the concerns in FS#19045. Signed-off-by: Dan McGee <dan@archlinux.org>
2010-09-21Add debugger when having to parse lastsync fileDan McGee
Signed-off-by: Dan McGee <dan@archlinux.org>
2010-09-21Add mirror status viewDan McGee
Signed-off-by: Dan McGee <dan@archlinux.org>
2010-09-21Add 'mirrorcheck' commandDan McGee
This does the actual work of going out and checking the mirror status. In short, it polls every active mirror URL for the 'lastsync' file and then records the appropriate details. These include the contents of that file, how long the total time to retrieve took, and any errors encountered. In order to finish up a bit faster, we spawn several threads to do the actual work. This parallelization allows the whole check process to take around 30 seconds rather than several minutes. Signed-off-by: Dan McGee <dan@archlinux.org>
2010-09-21Rename generate mirrorlist viewDan McGee
Signed-off-by: Dan McGee <dan@archlinux.org>
2010-09-21Add new MirrorLog model and associated migrationDan McGee
Signed-off-by: Dan McGee <dan@archlinux.org>
2010-09-21Auto-populate slug on news item creationDan McGee
And make sure it is unique through a few queries and some magic. Signed-off-by: Dan McGee <dan@archlinux.org>
2010-09-21Update news views to use slug instead of IDDan McGee
Signed-off-by: Dan McGee <dan@archlinux.org>
2010-09-21Add migrations to populate the news slug and make it non-nullDan McGee
These should get us all set to have more useful URLs for the news items. Signed-off-by: Dan McGee <dan@archlinux.org>
2010-09-21Add news slug fieldDan McGee
Initially, this needs to allow null so that we can add in slugs for all of our old news items. Signed-off-by: Dan McGee <dan@archlinux.org>
2010-09-20Update news permission required stringrelease_2010-09-20Dan McGee
When moving the news model and updating the content type, I forgot to update these strings to reflect the new permission name. Whoops. Signed-off-by: Dan McGee <dan@archlinux.org>
2010-09-20Fix package differences pkgrel comparisonDan McGee
Using the right index in the array might help; we were comparing pkgver again and not pkgrel at all. Signed-off-by: Dan McGee <dan@archlinux.org>
2010-09-16Remove some leftover print statementsDan McGee
Signed-off-by: Dan McGee <dan@archlinux.org>
2010-09-15Spruce up news admin viewDan McGee
Add last modified date as a column, and fix up some other small display, sorting, and ordering issues. Signed-off-by: Dan McGee <dan@archlinux.org>
2010-09-14Ensure consistent date formatting everywhererelease_2010-09-14Dan McGee
Set up a default DATE_FORMAT in settings.py and use it everywhere we do the '|date' template filter rather than hardcoding the value in the template. This also fixes a regression with news date/time now that we changed the field to store both date and time. Signed-off-by: Dan McGee <dan@archlinux.org>
2010-09-14Re-enable etagsDan McGee
Signed-off-by: Dan McGee <dan@archlinux.org>
2010-09-14Improve request handling for feeds that haven't changedDan McGee
By using the condition decorator (in a slightly odd way because these are class-based views), we can cut down a lot on the response time for returning 304 status code for feeds that haven't changed. The decorator means we no longer have to completely render the view to see if we can return a 304 status code. Signed-off-by: Dan McGee <dan@archlinux.org>
2010-09-14Reorder middleware to be more inline with Django defaultsDan McGee
Signed-off-by: Dan McGee <dan@archlinux.org>
2010-09-14Add last modified date to newsDan McGee
This will come in handy when determining whether resources are out of date, such as our news RSS feed. Also bump the Date fields to DateTime fields for sake of sorting and if we have more than one news item on the same date. Signed-off-by: Dan McGee <dan@archlinux.org>
2010-09-12Bump requirements for Django security releaseDan McGee
Signed-off-by: Dan McGee <dan@archlinux.org>
2010-09-12reporead: revamp database parsing codeDan McGee
This needed a little sprucing up as it has grown quite organically over the life of this script. Make things a bit more pythonic through the use of iterators rather than collection indexing, and try to generalize the special cases of things a bit. Also catch encoding problems early and fail gracefully rather than blow up the entire package parser. A failed decode of a file should cause us to just skip it rather than stop the entire parser. Worst case, this leaves that package out of the web interface. Signed-off-by: Dan McGee <dan@archlinux.org>
2010-09-12Check for correct permission when creating usersrelease_2010-09-12Dan McGee
Signed-off-by: Dan McGee <dan@archlinux.org>
2010-09-10Restore flagged package count by maintainer in dashboardDan McGee
We need to do a little dropping into SQL to accomplish this, but it isn't all that bad to actually do and we can do the whole thing in one query. Signed-off-by: Dan McGee <dan@archlinux.org>
2010-09-10reporead: allow traceback on USR1 signal as wellDan McGee
When I have caught reporead behaving badly on the production box, I haven't been able to successfully get a traceback without killing the process. Hopefully using a different signal will allow me to actually capture some data. Signed-off-by: Dan McGee <dan@archlinux.org>
2010-09-10Remove SomethingFishyExceptionDan McGee
Just use a plain Exception instead since we don't get any added value by subclassing. Signed-off-by: Dan McGee <dan@archlinux.org>
2010-09-09Improve todo list view pageDan McGee
Add total package count and incomplete package count columns. Also reduce the number of total queries by killing the query per row that was happening before. Signed-off-by: Dan McGee <dan@archlinux.org>
2010-09-09Remove redundant text from groups package count columnDan McGee
Signed-off-by: Dan McGee <dan@archlinux.org>
2010-09-09After moving models, update content type tablerelease_2010-09-09Dan McGee
The one thing that people forget to mention when moving models from one Django app to another. I was fooled here. Signed-off-by: Dan McGee <dan@archlinux.org>
2010-09-09Hide multilib by defaultDan McGee
Signed-off-by: Dan McGee <dan@archlinux.org>