263b5c9ce2
api py3 fix
2016-09-23 22:57:46 +02:00
29600fa5f7
import unquote, fixes #2969
2016-09-20 15:59:49 +02:00
23143185ea
item can be unavailable
2016-09-20 02:55:06 +02:00
55f9d9f58b
dont create missing tasks
2016-09-20 01:16:58 +02:00
58c762a624
map needed more often, fix cad911a
2016-09-19 20:24:36 +02:00
cad911a807
only use -map for audio if needed
2016-09-19 20:05:57 +02:00
16d10e1c3f
import settings
2016-09-19 19:59:29 +02:00
48fae31b62
better debug
2016-09-19 12:04:35 +02:00
2c6609b308
typo
2016-09-18 16:31:14 +02:00
6c013ebc92
first version of new upload interface
2016-09-15 15:20:57 +00:00
8feed54bf9
cancelled->canceled
2016-09-15 15:20:57 +00:00
cf0fcdbc5f
only paste into small timeline if it exists
2016-09-15 15:20:57 +00:00
750633eb7e
avoid recomputing timeline for each part
2016-09-15 15:20:57 +00:00
285877054e
fix document lookup
2016-09-15 13:52:54 +02:00
3ac08aa806
make moveMedia async
2016-09-08 00:29:31 +02:00
bea661abcf
taskId must be in data
2016-09-07 20:23:31 +02:00
4d9761a32c
make update_external async
2016-09-07 20:16:25 +02:00
844d1697bd
remove unused annotation.tasks.update_matches
2016-09-06 00:19:36 +02:00
4d1711cb01
only update subtitles if needed
2016-09-06 00:13:40 +02:00
d53659c0c4
move annotation update_matches logic into models
2016-09-05 23:46:36 +02:00
5d43ed0585
Merge changes
2016-09-05 18:17:06 +02:00
3cb9281d6d
w should never be 0
2016-09-05 18:16:39 +02:00
400162e400
full_tile_widths can be 0 for items with many parts
2016-09-05 15:47:36 +02:00
bf984fe256
return item info for 0x urls
2016-09-05 13:45:24 +02:00
0f0f5f42d8
space
2016-08-31 19:07:44 +02:00
1c580a2df7
async update of annotation matches, fixes deadlock in load_subtitles
2016-08-31 18:03:19 +02:00
3913373c9b
update db if guest was reclassified as robot
2016-08-31 17:38:40 +02:00
680efc967c
processing trumps queued
2016-08-31 12:23:41 +02:00
c409b63f25
__future__ print
2016-08-31 01:33:41 +02:00
5ced5cf791
return url
2016-08-31 01:30:13 +02:00
89311c14b4
typo
2016-08-31 01:30:13 +02:00
cf3161d4bd
better findMedia
2016-08-31 01:30:13 +02:00
fc6cc93d26
keep import url
2016-08-31 01:30:13 +02:00
4d9e8a788a
add task for queued downloads
2016-08-31 01:30:13 +02:00
1ec69b9c05
more py3 fixes
2016-08-31 00:33:08 +02:00
6aabe8d9df
py3 fixes
2016-08-31 00:31:38 +02:00
9b3547f9bc
fix tv
2016-08-28 15:05:52 +02:00
78c26daaeb
update poster after processing stream
2016-08-28 13:38:46 +02:00
f71334ae25
avoid ad
2016-08-28 13:25:26 +02:00
da89a9748a
include download task
2016-08-28 12:22:31 +02:00
029bcfee29
files are queued after download
2016-08-28 12:22:08 +02:00
11e36b550e
update task after updating item
2016-08-25 18:34:49 +02:00
1dd574cb9e
task queue has status not state
2016-08-25 18:34:49 +02:00
8136a2c2f5
create new item if unregistered file gets uploaded
2016-08-25 18:34:49 +02:00
181f27b93a
fix audio only uploads
2016-08-25 18:34:49 +02:00
1468ddbecb
towards supporting python 2 and 3
...
- use absolute_imports
- make use of six.moves
- use exec instead of execfile
- use list(dict) instead if dict.keys()
2016-08-25 18:34:36 +02:00
479432f01a
upload_date can be none
2016-08-25 18:32:28 +02:00
83c2e25aac
support editable as result in find
2016-08-25 18:32:28 +02:00
97a46dceb0
fix sort of static edits
2016-08-23 13:24:27 +02:00
9685c7e4a5
fix streams for static edits
2016-08-23 13:24:22 +02:00
b4074303ba
avoid error in error handler and render 500 page
2016-08-23 01:37:38 +02:00
d7b53aa322
limit cronjob rate if multiple cronjobs end up in queue
2016-08-18 13:41:24 +02:00
e1cacdb67a
add task queue api
2016-08-17 14:37:59 +02:00
0eb873d2cb
fix hue, saturation, lightness calculation for multi part items
2016-08-15 15:14:44 +02:00
3d6d1be2e6
include oshash in video url to avoid cache issues
2016-08-13 15:36:00 +02:00
843cea063d
update timeline if part is changed
2016-08-13 15:34:28 +02:00
3b8dd55273
don't fail if 2 paths get flipped in a folder
2016-08-13 15:32:51 +02:00
8c928860e1
import url celanup
...
- only import first url
- pass empty string instead of undefined
- page can contain multiple videos, import as parts
2016-08-10 10:49:58 +02:00
b59a9c3122
set canImportItems in config.*.jsonc
2016-08-09 15:58:48 +02:00
2157b719ec
use more info from sort table, fixes #2953
2016-08-09 15:06:44 +02:00
c08ce51db2
add padma importMetadata
2016-08-09 14:25:39 +02:00
384c643326
no tags == []
2016-08-09 14:25:39 +02:00
9991767d01
no summary in default importMetadata keys
2016-08-09 13:03:21 +01:00
7f8b5448e6
set default config importMetadata
2016-08-09 12:57:43 +01:00
0430a0f236
cache getMediaUrlInfo
2016-08-09 12:57:43 +01:00
90486ec774
update menu and config
2016-08-09 13:35:47 +02:00
5ef6062613
import media dialog
2016-08-09 13:17:48 +02:00
926d3f0f09
add video id
2016-08-09 11:50:24 +01:00
337cafcf76
don't add base keys to Item.data
2016-08-08 15:54:52 +02:00
9a86ddce01
include upload_date
2016-08-05 17:57:40 +02:00
dce51305ce
update poster after extracting stream
2016-08-05 15:24:54 +02:00
c4a95bc320
update_poster should always update poster
2016-08-05 14:46:27 +02:00
2aef460225
do not set -ac if audiochannels is None
2016-08-05 14:46:27 +02:00
ff8dd16456
fix profile selection
2016-08-03 11:41:46 +02:00
5447aab0a1
more current values
2016-07-30 12:04:35 +02:00
dcf3acbd44
store facets in NFKD
2016-07-30 12:01:34 +02:00
dffb25e0e8
poster might still point to old id, after rename, delete and make new one. fixes #2944
2016-07-30 10:02:53 +02:00
5c90ff79a0
cleanup poster cache
2016-07-30 09:39:31 +02:00
893f2e5423
add importMediaDialog
2016-07-30 02:49:43 +02:00
383ad8a535
fix findMedia by item id
2016-07-24 17:52:33 +02:00
6f4a0ba90a
support vtt subtitles
2016-07-01 21:13:13 +02:00
f8f951c966
remove outdated fixmes
2016-07-01 17:53:59 +02:00
d780045306
flake8
2016-07-01 17:48:43 +02:00
3166bf5beb
show timeline errors
2016-07-01 17:34:45 +02:00
5434ffbf53
make_poster no longer takes arguments
2016-07-01 12:44:07 +02:00
88c800a093
use data['positions']
2016-06-30 16:42:56 +02:00
c7157d5001
only decode ids for found positions
...
merge document.view.get_positions into item.utils.get_positions
add flag to decode id before looking up in ids
Followup to 09ebbc9cc6
2016-06-30 16:18:07 +02:00
3d95d7013a
Merge remote-tracking branch 'wjt/2935-findDocuments-performance'
2016-06-30 15:43:09 +02:00
e9863c238e
always use get_operator, avoid case-insensitive match if possible
2016-06-30 11:28:09 +02:00
5b545e6e43
layer first
2016-06-30 02:42:24 +02:00
b6e4d33a43
add Annotation.findvalue index (used by findClips)
2016-06-30 02:42:24 +02:00
b63024df02
show source info if encode fails
2016-06-30 00:23:56 +02:00
b5bc17f925
make layer itemKeys with filter=true show up in searching for *
2016-06-30 00:17:23 +02:00
09ebbc9cc6
findDocuments: improve performance of positions queries
...
References #2935
2016-06-28 16:36:55 +01:00
8d25e3be78
findDocuments: improve entity query performance
...
When I implemented this in 9a4c24c#2935
2016-06-28 16:33:01 +01:00
5aeffcfb6a
check first audio track
2016-06-27 16:51:18 +02:00
adfcc1cb27
never set display aspect ratio to 0:0
2016-06-27 16:08:30 +02:00
8ac78f3bd6
remove unused force flag from make_poster, update_timeline
2016-06-26 23:24:11 +02:00
0f9e80e1e6
avoid saving item twice
2016-06-26 23:22:27 +02:00
de9b062d63
make sure existing index is using gin
2016-06-26 16:55:58 +02:00
ab0dfddf31
set SECURE_PROXY_SSL_HEADER by default
2016-06-26 15:34:19 +02:00
0d89ad640b
ignore some broken audio codecs
2016-06-26 15:33:52 +02:00
92f642cbac
pcm sound can have no codec
2016-06-26 14:41:58 +02:00
2cec1b9ad5
s/import Image/from PIL import Image/g
2016-06-25 20:39:29 +02:00
4785f314cb
Add VP9/Opus support, use VP8 by default
...
- support vp9 and opus
- switch to 2 pass encoding
- use ffmpeg -movflags +faststart instead of qtfaststart
2016-06-23 17:36:41 +02:00
aaacc48259
only save if update_external fails
2016-06-20 18:28:05 +02:00
d83647c4a5
don't hide oxtimelines errors
2016-06-20 18:27:31 +02:00
6dcbcdd19c
dont update timeline in update_selected, remove unused async get_item case
2016-06-16 14:48:54 +02:00
0486d62ec9
use absolute path
2016-06-16 14:48:09 +02:00
f25218466b
formating
2016-06-16 14:48:01 +02:00
70f34bfde9
typo
2016-06-15 19:13:00 +02:00
e3c5ab18c7
only update itemsort if name is changed
2016-06-15 18:31:40 +02:00
22f83288c5
avoid looking up item twice
2016-06-15 18:29:09 +02:00
7c53dca65b
less async item creation
2016-06-15 18:12:59 +02:00
b2a9a5f711
space
2016-06-15 17:56:31 +02:00
3c1f4a8c95
dont call module
2016-06-15 17:55:57 +02:00
b010aca0a9
s/taskId/id/
2016-06-15 15:45:51 +02:00
a0fc6ffadc
typo
2016-06-15 14:55:45 +02:00
f4cbe6a114
return empty sequences if no data timeline exists
2016-06-15 14:48:02 +02:00
af0e0cffe8
person can be removed again, let async itemsort fail without exception
2016-06-15 14:34:46 +02:00
fd9d3bdabf
flake8 + map->[]
2016-06-15 14:34:46 +02:00
05c4cfcbc8
add space and other flake8 cleanups
2016-05-28 11:30:43 +02:00
5e149a5cb8
add space and other flake8 cleanups
2016-05-28 11:26:46 +02:00
225259e521
add space and other flake8 cleanups
2016-05-28 11:18:51 +02:00
f21e8413fb
use get_random_string
2016-05-28 11:18:51 +02:00
7fdaf6d1ce
include Access-Control-Allow-Origin in 404 not found response
2016-05-27 11:51:47 +02:00
05e6118a88
findAnnotations: include duration alongside result count
...
fixes #2921
2016-05-05 15:54:25 +01:00
41cc8e3573
expose encoding status via api
2016-05-05 10:49:34 +02:00
be163826ef
Merge remote-tracking branch 'wjt/fix-migrations'
2016-05-05 10:48:24 +02:00
39b9b48be2
archive: fix migrations for upload_to function renamings
...
9c75526
2016-05-04 17:01:44 +01:00
e29ea230fb
Add migration for Document.documentproperties ref
...
This should have been included with a8dcbbb
2016-05-04 16:55:11 +01:00
0f28a2b7d5
fix queue status
2016-04-30 14:15:13 +02:00
9c7552699f
fix upload_to callbacks
2016-04-29 13:46:55 +02:00
2812834ce3
findAnnotations: don't lowercase ids ( fixes #2916 )
...
Without this fix, a condition like:
{key: 'id', operator: '==', value: 'A/B'}
gets mapped to:
public_id__exact=('A/B'.lower())
which is wrong.
I introduced this bug in b3df5b8
2016-04-29 11:03:45 +01:00
aa40a40595
Annotation.json: only include entity id & name
...
Fetching documents for each entity in turn is expensive. (I have tried
using ArrayAgg to fetch them in the same query as the Entity — no
improvement. It's possible that being able to join to entity_entity,
and then use ArrayAgg, would be better.)
Even once you've fetched them all, if the same entity appears many
times in an item, then get(..., keys=['layers']) duplicates the whole
JSON for the entity many times: expensive to serialize, expensive to
send over the wire.
Pandora's own web interface only depends on the 'id' key of 'entity' in
each annotation, and refetches the rest of the entity to show the pop-up
dialog when you press E. So by just not bothering to fetch and send any
other keys, get(..., keys=['layers']) on an item with many entity
annotations is substantially faster.
(I experimented with splitting the full entities off to one side, so,
you'd have:
{
"layers": {
somelayer: [...,
{..., "entity": {"id": ABC}},
], ...
},
"entities": {
ABC: {...},
...
}
}
This is quicker than the status quo, but obviously not as fast as not
fetching & sending the rest at all!)
2016-04-28 14:15:23 +01:00
aa0fbc9d4a
Entity.json: get document ids from join table
...
This is a bit quicker because it's just a lookup in a single table, not
a join.
2016-04-28 14:15:12 +01:00
400b6650a2
Annotation.json: document empty-subtitle special case
2016-04-19 13:52:52 +01:00
af0d87b569
Annotation.json: reduce repeated layer lookups
...
It's actually quite costly to look up keys in CONFIG, particularly
inside a loop: this trims ~5% off get(keys=['layers']) for
annotation-heavy items.
2016-04-19 13:52:47 +01:00
3f5be0bd27
findClips: look up entity names ( fixes #2804 )
2016-04-19 12:28:58 +01:00
d0129a4416
findClips: avoid O(n²) lookup of clip from annotation
...
This doesn't make much difference for small ranges, of course.
2016-04-19 11:25:12 +01:00
ba00bcbf7b
findClips: select_related('item') / ('item__sort')
...
Clip.public_id uses self.item.public_id.
Clip.json() uses self.item.sort, so we should select_related on that
rather than the clip's own sort field. (They are identical objects. Is
Clip.sort ever used directly?)
With this change, findClips() issues one query to fetch clips plus one
query per flavour of annotation; before, it issued two extra queries per
clip.
2016-04-19 11:25:06 +01:00
6dbb7f921a
findClips: only scan layers once
2016-04-19 11:14:25 +01:00
b3df5b8d56
findAnnotations: match some fields case-sensitively
...
Requiring layer to have the right case is consistent with
addAnnotation(), and means the _layer[_like] index can be used. In my
testing, if itemsQuery specifies a single item, then postgres doesn't
bother with the layer index anyway; but if not, it makes a pretty big
(~3×) difference.
Matching public_id and item__public_id case-sensitively also seems
reasonable (it's consistent with get() and getAnnotation()).
(Is lower() redundant for the case-insensitive comparisons? ie. is
UPPER(x.lower()) == UPPER(x)? I'm not sure, it's cheap, let's leave it.)
2016-04-05 12:19:32 +01:00
8d1b4de337
findAnnotations(): make 'findvalue' the default key
...
Annotations have no 'name' field, so
findAnnotations({query: {conditions: [{value: 'foo'}]}})
would previously raise an exception.
2016-04-05 12:19:31 +01:00
284caf03c3
get_by_key: short-circuit
...
This is about 30% faster, presumably because it avoids allocation and/or
closing over variables is slow(?). It's not hugely significant (I
misread a line_profile report) but why not.
2016-04-05 12:19:31 +01:00
7ac68697d4
update pdf.js
2016-04-04 15:50:07 +02:00
652df88342
return 404
2016-04-04 15:50:07 +02:00
1bff4aa0e9
avoid storing invalid poster frames, only show videos with video
2016-04-01 16:40:20 +02:00
b8beb51480
fix multipart audio only timelines
2016-03-31 14:54:38 +02:00
94b940436f
fix timelines for items with many parts
...
- use durations from streams not from timelines
- don't accumulate timeline drift
2016-03-19 18:58:48 +01:00
