Commit graph

137 commits

Author SHA1 Message Date
j
620c8a7d96 fix document creation 2017-01-27 12:26:55 +00:00
j
b23ca9df74 store document references in db 2017-01-26 15:56:28 +00:00
j
e4316c9b44 document references 2017-01-25 21:45:54 +01:00
j
0db8ca6c47 document icon, fixes #2987 2017-01-25 17:42:49 +01:00
j
aeab4d03de keep private texts private 2017-01-25 17:39:12 +01:00
j
bf8c99513b no access to private documents 2017-01-25 00:13:37 +01:00
j
c4350e2334 py3 2017-01-24 16:19:34 +01:00
j
f71240ac2c look in the right place, fixes #2989 2017-01-20 17:44:31 +01:00
j
6ad112a3b8 fix pdf upload 2016-11-30 11:36:29 +01:00
j
95131a6429 use lower case extensions 2016-10-30 18:23:16 +01:00
j
e1f35b1ec8 new documents section 2016-10-30 18:23:16 +01:00
j
d4a232d594 py3 decode 2016-10-28 18:18:26 +02:00
j
9ef306ab53 support getting related items 2016-09-23 22:58:31 +02:00
j
b7659d6f14 cleanup document cache after upload 2016-09-23 22:58:31 +02:00
j
29600fa5f7 import unquote, fixes #2969 2016-09-20 15:59:49 +02:00
j
1468ddbecb towards supporting python 2 and 3
- use absolute_imports
- make use of six.moves
- use exec instead of execfile
- use list(dict) instead if dict.keys()
2016-08-25 18:34:36 +02:00
j
c7157d5001 only decode ids for found positions
merge document.view.get_positions into item.utils.get_positions
add flag to decode id before looking up in ids

Followup to 09ebbc9cc6
2016-06-30 16:18:07 +02:00
j
3d95d7013a Merge remote-tracking branch 'wjt/2935-findDocuments-performance' 2016-06-30 15:43:09 +02:00
j
e9863c238e always use get_operator, avoid case-insensitive match if possible 2016-06-30 11:28:09 +02:00
09ebbc9cc6
findDocuments: improve performance of positions queries
References #2935
2016-06-28 16:36:55 +01:00
8d25e3be78
findDocuments: improve entity query performance
When I implemented this in 9a4c24c, there were not many rows in
entity_documentproperties in the database here. Now that there are,
computing the document_document -> entity_documentproperties ->
entity_entity join and then filtering is really, really slow. Postgres
seems to materialize the whole join and then scan it.

If we get a set of matching document IDs for the entity query in a
subquery, and then just filter with IN on that, things are much faster:
scan entity_entity; in a nested loop, get the document_ids via
entity_documentproperties; hash this set; and then scan
document_document.

Searching for a single character, this brings the query from ~1.1s to
~400ms. Searching for a full word, ~800ms to 120ms

This condition is getting really ugly -- I am sorry!

References #2935
2016-06-28 16:33:01 +01:00
j
2cec1b9ad5 s/import Image/from PIL import Image/g 2016-06-25 20:39:29 +02:00
a8dcbbbe89 Include DocumentProperties.data in Document.json() 2016-03-05 15:07:47 +05:30
9a4c24cdb4 Support searching documents by entities 2016-03-04 12:41:41 +00:00
738a9282b4 Document: fix negating id queries 2016-03-04 12:41:41 +00:00
6e0049a20c Don't save Document in pre_delete handler (fixes #2889)
FileField.delete() will, by default, save() the model instance it is
attached to. This is pointless if we're in the process of deleting the
Document -- and since Document.save() calls Document.update_matches(),
this scans all annotations every time a document is deleted.
2016-03-03 18:10:29 +05:30
j
051a3578b4 inline django 1.9 version of ox.django 2016-02-20 10:41:23 +00:00
j
0367816257 only crop with 4 crop points 2016-02-20 10:41:22 +00:00
j
4219246909 db migration 2016-02-20 15:15:01 +05:30
j
1cc795995d user.get_profile()->user.profile 2016-02-19 22:06:11 +05:30
j
5d63ad1760 default/upload_to=lambda breaks migrations, use functions 2016-02-19 21:59:26 +05:30
j
e738503380 remove old migrations 2016-02-19 15:17:18 +00:00
47d8d67c3d Allow 'query' to be omitted from find*() (fixes #2883)
I hit this in findDocuments() so thought I'd fix them all.
2016-02-15 14:58:50 +00:00
j
54b7c4be9a update dimensions replacing documents, add modified to image urls to get latest version 2015-10-26 16:10:12 +01:00
j
6f9fb06da3 Replace Document, still some cache issues, fixes #2855 2015-10-25 22:08:13 +01:00
b7a83554ab Fix references to findDocument[s] in docstrings 2015-05-20 12:14:21 +02:00
j
6693bfcd0f return document or 404 no 500 2015-02-20 15:13:23 +00:00
j
a2e23739b8 return id in response, fixes #2058 2015-02-14 18:29:58 +00:00
j
ccfaa7db4a add entity/document relation 2015-02-13 11:06:09 +00:00
j
809486b43c cropped thumbnails of image documents 2015-02-05 08:08:28 +00:00
rolux
ea1a94e9e4 update api docs (omissions, wording, typos) 2014-12-21 13:03:49 +00:00
rolux
3950213960 update api docs 2014-12-19 15:31:57 +00:00
rolux
cada20f904 update api docs 2014-12-19 15:05:08 +00:00
rolux
4a084d8405 update api docs 2014-12-19 12:59:10 +00:00
rolux
7cfdf7b8db update api docs 2014-12-18 18:18:18 +00:00
j
9e9bf30c42 add new changelog and call add_changelog all over the place 2014-12-17 13:45:46 +00:00
j
e98b97842e send 404 not 500 if document does not exist 2014-11-20 13:24:43 +00:00
j
c6bd95050a typo 2014-11-20 12:41:41 +00:00
j
d12121d229 more thumbnail cleanups 2014-11-01 18:09:33 +02:00
j
f4779195a2 fix pdf ratio 2014-11-01 15:42:16 +02:00
j
ceb507020b data is passed to api functions now 2014-10-06 08:26:43 +00:00
j
3232ce6989 rename Item.itemId to Item.public_id 2014-09-19 12:26:46 +00:00
j
72d9dbf0f2 avoid passing open network connections to subprocesses, call Popen with close_fds=True 2014-09-02 14:24:12 +00:00
j
df44b0daf4 make per item document info editable if user can edit item 2014-04-17 19:32:30 +00:00
j
7cd152b1d5 refactor chunk upload: return offset, continue at server offset 2014-04-11 16:56:22 +00:00
j
22e3a9eedd upload chunks with offset. fail if uploaded file does not match oshash 2014-04-11 12:08:14 +00:00
j
36307a6060 remove type from backend, fixes #1949 2014-02-18 07:01:11 +00:00
j
b2c7f3156d add getDocument api, fixes #2313 2014-02-16 10:15:45 +00:00
j
d94b5d1db0 fix deleting documents 2014-02-14 13:35:40 +00:00
j
3c1d3bbcb2 update item sort after adding document to item, fixes #2153 2014-02-03 08:54:37 +00:00
j
17586c1d2a cleanup document thumbnails 2014-02-02 06:35:04 +00:00
j
167de4cc97 add thumbnails of pdf pages #2148 2014-02-02 06:30:58 +00:00
j
a1af2bea9c fix pdf width 2014-02-01 17:04:40 +05:30
j
dada4cbf4c fix findDocuments by id 2014-01-17 13:14:40 +00:00
j
49057ac14a remove list option from addDocument, fixes #2032 2014-01-16 05:30:54 +00:00
j
3ff178ed83 add option to add documents to all items in list 2014-01-09 08:05:35 +00:00
j
b26c5d282f fix sort by description in item view 2014-01-08 09:12:44 +00:00
j
b4b8e08231 fix adding items to empty list 2014-01-08 08:35:02 +00:00
j
d1014334be fix per item document description 2014-01-08 04:32:57 +00:00
j
573592092a null last 2014-01-07 16:19:27 +00:00
j
e1953b671d dimensions_sort 2014-01-07 15:34:07 +00:00
j
388f4c9d74 add key=item support to findDocuments 2014-01-07 14:00:20 +00:00
j
9a60e569d6 fixes #1999 2014-01-07 11:42:20 +00:00
j
0e55faca0d update documents backend 2014-01-07 11:05:10 +00:00
j
6b63239cf7 fix pdf ratio 2014-01-05 11:40:54 +00:00
j
ff13a30639 add resolution/pages to documents, use poppler-utils to extract pdf pages. 2014-01-04 12:29:11 +00:00
j
d1ed4ce79d fix permission error 2014-01-02 12:27:53 +00:00
j
19b8bcfc83 allow uploading/deleting multiple documents, fixes #1960. replace select option with item aware add button, fixes #1961 2014-01-02 10:11:27 +00:00
j
c248a4c227 return thumbnails for images instead of full image 2013-12-23 12:32:23 +00:00
j
4eeb10e3ba use AZ id for document data path 2013-12-23 11:30:22 +00:00
j
81706fcf3b change document urls to be /documents/ID/name.ext 2013-12-23 11:26:48 +00:00
j
dc88fcd175 use _ for spaces in document urls, fixes #1955 2013-12-22 12:13:37 +00:00
j
e6117dfc61 fix document upload, add select callback option to document dialog, ctrl-alt-n works to add documents 2013-07-08 11:40:18 +00:00
j
59f2e8da01 send signal for new app name to avoid exception during install 2013-07-03 16:14:56 +02:00
j
27877df0cd one more file->documents 2013-05-27 20:03:18 +00:00
j
71846d5461 add per item document api 2013-05-27 11:21:08 +00:00
j
8da6badf4c rename files to documents and use media for media files 2013-05-27 10:13:59 +00:00