907894dda3
Merge branch 'master' into v2.0.0
2020-12-17 23:18:00 +01:00
4cd822f068
Update gomod to reflect repo transfer
2020-12-17 22:51:43 +01:00
092cbdb872
Migrate FormatSQL
2020-12-17 21:32:13 +01:00
7546987f85
Fixed issue that caused runtime error: invalid memory address or nil pointer dereference
...
because the sidecar file was trying to process before the highResMediaURL and thumbURL are actually created
2020-12-15 02:25:30 +02:00
48c3ed93f2
Fix api tests
2020-12-14 10:41:00 +01:00
4f370deab9
Merge remote-tracking branch 'origin/master' into v2.0.0
2020-12-10 12:30:10 +01:00
6adc79001c
Photo duplication detection ( #148 )
...
* Fixes viktorstrate/photoview#8
- Added new property CounterpartPath to Media struct to hold the path to the counterpart JPEG file (if any)
- Added new MediaType method isBasicSupportedisBasicTypeSupported()
- Added new function isFileExists() to minimize the code duplication
* Fixes viktorstrate/photoview#8
- Chaned CounterpartPath definition from string to *string
- Added new helper method FileExtensions()
- Simplified the logic inside scanForRawCounterpartFile() and scanForCompressedCounterpartFile() functions, reducing the code duplication
* Fixes viktorstrate/photoview#8
- Added debug to fileExists() function
* Cleanup fileExists logging
Co-authored-by: viktorstrate <viktorstrate@gmail.com>
2020-12-09 11:40:37 +01:00
f0d580116b
Improve album and media resolvers
2020-12-08 16:24:08 +01:00
4b778fbdde
Fix tests, fix photo route
2020-12-06 15:24:15 +01:00
98f13d76e6
Replace database, work on scanning
2020-11-30 21:29:49 +01:00
364521958b
Fix site_info, replace ID type in graphql queries
2020-11-30 16:42:13 +01:00
e42ac2436b
Replace database, resolve all build-time errors
2020-11-28 21:29:31 +01:00
2b966aa672
Replace database, mostly media and video
2020-11-26 20:48:04 +01:00
177ae91500
Replace database, mostly video
2020-11-25 23:06:47 +01:00
cc5d323b2a
Replace database, mostly process photo
2020-11-24 11:46:49 +01:00
2e9aa29258
Replace database, mostly media related
2020-11-23 20:43:00 +01:00
3c23f82330
Replace database, mostly album related
2020-11-23 19:59:01 +01:00
27b2f95a7b
Start on migrating database integration to gorm
2020-11-23 19:39:44 +01:00
9787fd570f
Cleanup and bugfixes
...
- Fix bug where unsupported media would be wrongly classified
- Fix bug where sidecar hash wouldn't be updated
- Replace error reporting hash with path,
to avoid potential null pointer exceptions
2020-11-22 23:42:42 +01:00
43e759339e
Update generated images on sidecar file change
2020-11-21 12:19:00 +00:00
11d67c9ae9
Add sidecar path & hash to DB
2020-11-21 11:54:01 +00:00
74581ee090
Cleanup media routes and media_name generation
2020-10-30 17:14:09 +01:00
bbff25973e
Fix bug where max_concurrent_tasks for...
...
scanner queue would be initialized to 0.
2020-09-24 17:52:53 +02:00
44a00c7415
Move setup of executable workers to function
...
- Fix startup crash if no site_info row was found
2020-09-23 14:34:26 +02:00
9c9807ecc9
Add admin setting to change max concurrent workers
2020-09-21 21:32:30 +02:00
05380354e3
Setup periodic scan background runner
2020-09-21 12:34:56 +02:00
f2493c80a5
Fix small bug where CleanupMedia...
...
would not remove old media if the album
did not contain any media at all but only sub-albums
2020-08-15 13:58:03 +02:00
8e7c43798a
Rotate images properly
...
This fixes #64 where some thumbnail images
would not have the correct orientation.
2020-08-15 12:24:54 +02:00
e0ab77b158
Use file modTime instead of changeTime...
...
to determine the date_shot value of pictures.
This value is cross-platform,and probably a
better representation for the date_shot
2020-08-14 12:20:14 +02:00
78b415871d
Add date information to media
...
This closes #61
2020-08-12 13:04:41 +02:00
cdb4089f19
Ignore hidden media files
...
This closes #57
2020-08-12 12:31:13 +02:00
849f2f25bf
Add fileSize to media_url database entries
2020-08-11 22:18:15 +02:00
b52595fe46
Save gps coordinates from exif
...
This closes #62
2020-08-11 14:46:23 +02:00
01bec379c7
Move `deleteOldUserAlbums` function to `cleanup_media.go`
2020-08-03 19:39:39 +02:00
e89c84f45f
When a photo is deleted or moved on the file system, the coresponding cache folder and database record are deleted.
...
fixes #56
2020-07-24 20:50:17 +03:00
82b18f0e9b
Cleanup + add video format
2020-07-13 18:01:31 +02:00
d681d1538c
Cleanup regarding video support
2020-07-12 14:31:50 +02:00
0e9d37ca77
Add video metadata
2020-07-12 14:17:49 +02:00
990a592fcc
Expose media_type to graphql
...
- Make video thumbnail accessible from graphql
2020-07-11 14:21:10 +02:00
9e5480188b
add media_type column to media table in database
2020-07-11 14:05:06 +02:00
0eb0319fa8
Generate video thumbnails
2020-07-11 13:39:11 +02:00
26a5c5ac29
Encode videos for web using ffmpeg
2020-07-11 13:13:31 +02:00
0ab6048151
Fix scanner
2020-07-10 18:57:27 +02:00
df80802cab
Huge refactor: rename photo to media
...
To prepare for video support
Migrate database rename tables and columns:
- photo to media
- photo_url to media_url
- photo_exif to media_exif
- Update api accordingly
2020-07-10 14:26:19 +02:00
3564866f41
Start on video processing
2020-07-10 12:58:11 +02:00
7caad82059
Add ffmpeg worker and supported video formats
2020-07-09 15:07:39 +02:00
642afe4966
scanner_user.go uses hashes now
2020-06-24 13:52:40 +03:00
e70da6bb26
Merge remote-tracking branch 'upstream/master' into use-hash-instead-of-full-path-to-avoid-key-length-maximum
2020-06-24 13:42:43 +03:00
f88fa33e5f
InnoDB has a maximum index length of 767 bytes for tables that use COMPACT or REDUNDANT row format, so for utf8mb3 or utf8mb4 columns, you can index a maximum of 255 or 191 characters, respectively.
...
That's why I created a new column storing a MD5 hash of the path and made it unique. The MD5 hash has only 32 characters and can be generated natively in MySQL and MariaDB. It helps us to avoid maximum key length and in the same time enforce unique photo and album paths.
- Added path_hash column to photo and album tables
- Added down migration file for 005_utf8_migration (just for consistency)
- Added PathHash field to Album and Photo struct
- album_scanner.go and photo_scanner.goo perform checks by MD5 hash now
2020-06-24 11:43:20 +03:00
fba41918f4
Fix formatting error
2020-06-23 17:02:44 +02:00
66a4288ec9
Throttle queue notifications
2020-06-23 16:46:38 +02:00
23461ee707
Fix bugs and improvements
...
- Fix a deadlock in the scanner cache
- Cleanup error messages and logs
2020-06-23 16:42:02 +02:00
e57a6f3dc0
Make sure not only new photos are scanned
...
Fix a small bug where a photo was marked as processed when it wasn't
2020-06-23 15:23:20 +02:00
11c3a92373
Reintregrate notifications with scanner
2020-06-23 15:13:07 +02:00
cc1eadaef4
Fix queue tests
2020-06-23 14:10:03 +02:00
95f4df4b7d
Start to integrate new scanner system with api
2020-06-23 00:40:47 +02:00
a22d002146
Major rework of scanner
2020-06-22 23:52:41 +02:00
666ecef4b3
Refactor scanner
...
- Move scanner cache to its own file
- Move album scanner related code to its own file
2020-06-22 21:52:53 +02:00
2f4212eeab
Start on scanner queue + add some tests
2020-06-22 18:02:21 +02:00
d213a42869
Add supported raw formats by darktable
2020-05-17 22:32:31 +02:00
b077f77c89
Make darktable run in parallel
...
by using different config directories for each photo
2020-05-17 21:49:29 +02:00
14f6f8f000
Fix error when encoding raw photos
...
where path contains spaces
2020-05-17 21:28:42 +02:00
ad7ff8d39d
Fix executable worker arguments
2020-05-17 16:08:58 +02:00
40265a18f7
Integrate executable worker, still working on darktable
2020-05-15 16:36:02 +02:00
76ade24041
start on executable worker
2020-05-15 15:23:21 +02:00
0754e600b7
Make EncodeImageJPEG a method of EncodeImageData
2020-05-14 15:17:23 +02:00
a4b37a392f
Split up process_photo into encode + process
2020-05-14 14:35:08 +02:00
4d57d43011
Determine image type by file extension
2020-05-13 15:28:50 +02:00
5a5c06fb32
Extract filetypes into its own type
2020-05-13 15:05:02 +02:00
43f5d85078
Don't show an error when scanning an empty file
...
Reference #32
2020-04-17 13:15:31 +02:00
d5227a4ce3
Make sure that photo directory for user exists
...
If user directory doesn't exist anymore report an error notification.
2020-04-16 11:23:34 +02:00
6e420dff41
Recover if EXIF decoding panics ( #33 )
...
This fixes #33 where a curtain image would cause the goexif2 library to
panic.
Now instead of crashing the entire program, it recovers and instead
prints an error to the console and ignores the EXIF data for that image.
2020-04-16 11:02:33 +02:00
afb0428c2d
Add username to scanner notifications
2020-04-15 11:27:34 +02:00
b254f3abaa
Implement ScanAll resolver
2020-04-15 11:21:16 +02:00
4e388c430c
Fix image EXIF orientation bug
...
Fix a bug where an image couldn't be scanned if the EXIF data were
missing the orientation field.
This resolves #29
2020-04-15 10:58:10 +02:00
7b3f016a0f
Add replace debounce with throttle
...
Update dependencies
2020-03-12 13:26:11 +01:00
bdec205031
Cleanup + debounce scanner notifications
2020-03-12 12:55:53 +01:00
179ec5283b
Implement proper photo rotation based on exif data
2020-03-12 12:30:55 +01:00
5b5ac5bbbd
Scanner - delete missing photos from database
2020-03-10 18:30:23 +01:00
ebe1220520
Skip hidden folders, this closes #13
2020-03-07 15:34:32 +01:00
5cee5d8dea
Add TIFF support, this closes #3
2020-03-02 16:32:24 +01:00
67fabd1de4
Fix graphql query for share pages
...
Properly close rows in scanner
2020-02-29 09:21:41 +01:00
2f97dcff0c
Improve scanner reliability
2020-02-27 16:26:53 +01:00
458b6fb49c
Improve scanner - first scan, then process
2020-02-26 21:23:13 +01:00
440814564c
Improve notifications
2020-02-26 19:44:47 +01:00
96ec3663b1
Continue on exif parser error
2020-02-24 23:45:02 +01:00
b10c607f3a
Add exif parsing
2020-02-24 23:30:08 +01:00
d27c20e041
Improve stability of scanner
2020-02-23 18:00:08 +01:00
39f68e4d8a
Support PHOTO_CACHE env variable
2020-02-23 12:43:45 +01:00
1e92432b07
Make scanner proceed on error
2020-02-23 11:59:57 +01:00
37aea1fb3a
Improve logging
2020-02-21 21:00:40 +01:00
935dc5b55e
Work on notifications + custom logger
2020-02-21 20:51:50 +01:00
64e702790f
Make scanner generate high-res jpg
...
If original image format is not supported in browser
2020-02-14 13:31:44 +01:00
9361e85397
Cache scanned album directories
2020-02-12 18:45:58 +01:00
4af6be17d8
Improve scanner cleanup to take user into account
2020-02-12 18:19:16 +01:00
a2d0509cad
Update scanner to delete removed files
2020-02-12 18:10:52 +01:00
d50a15be90
Work on scanner + add launch.json for vscode
2020-02-11 23:35:35 +01:00
6e72caf2f0
Improve integration with ui
2020-02-10 12:05:58 +01:00
a3a4dda286
Work on share tokens
2020-02-09 21:25:33 +01:00
e6593ee7f3
Working on integrating backend with ui
2020-02-09 15:26:59 +01:00
d50b8034d1
Work on photo serving and processing
2020-02-09 14:21:53 +01:00
9a8701ecd0
Improve image processing
2020-02-09 12:53:21 +01:00
9cf455f699
Add support for cr2 raw format
2020-02-02 21:44:09 +01:00
11896a246e
Work on image processing
2020-02-02 18:18:38 +01:00
d81e945b68
Start on image proccessing
2020-02-02 00:29:42 +01:00
a57c111630
Work on scanner
2020-02-01 17:58:45 +01:00
viktorstrate