81 Commits

Author	SHA1	Message	Date
Christian Kamm	5820ac8b41	Discovery: Files can have dehydrate/download actions ... This will be used in conjunction with vfs plugins that detect whether a file has a pending hydration/dehydration through independent means and communicate that to the discovery through local file type.	2020-12-15 10:58:38 +01:00
Christian Kamm	af1666788e	Discovery: Add signal for silentlyExcluded files ... This allows SyncFileStatusTracker to also know about these. After all its information is used to provide icons for them too.	2020-12-15 10:58:37 +01:00
Olivier Goffart	6f4bf585f0	Move: Fix move detection in directory move on the other side	2020-12-15 10:58:35 +01:00
Olivier Goffart	1fb4c22adf	Move: add more test and fix move within moves	2020-12-15 10:58:35 +01:00
Christian Kamm	836d298141	vfs suffix: Ignore server files or synced files with the suffix #6953	2020-12-15 10:58:34 +01:00
Christian Kamm	d956f518a8	vfs: Remove newFilesAreVirtual - use root PinState instead ... This unifies how to deal with pin states. Also enable reading a folders direct pin state vs its effective pin state.	2020-12-15 10:58:30 +01:00
Olivier Goffart	62ec4c9330	Discovery: Handle the blacklistFiles from the server capabilities ... Issue #434 Ideally one could add the blacklist to the exlucde reggexp, but this is simpler	2020-12-15 10:58:30 +01:00
Christian Kamm	486c25cb47	vfs: Use PinState in sync algorithm #6815 ... New files are virtual if the file's pin state is OnlineOnly.	2020-12-15 10:58:29 +01:00
Olivier Goffart	a29320b18d	Discovery: Set right direction when restoring deleted discovery because it has modified files ... (Catched by a faillure of t1.pl)	2020-12-15 10:58:29 +01:00
Christian Kamm	305d439c41	vfs: Separate vfs availability from new-files-virtual ... This helps support 2.5 settings where there are virtual files in the tree but new files aren't created virtual. It's also a prelude for #6815 There's currently no way of - upgrading vfs plugins (a silent suffix->winvfs upgrade is attempted once only, when moving to master) - disabling vfs capabilities outright	2020-12-15 10:58:27 +01:00
Christian Kamm	b30f79edf6	vfs: Ensure SyncOptions::_vfs is never null ... - Create a VfsOff derived class - Make it a shared pointer shared with Folder::_vfs	2020-12-15 10:58:26 +01:00
Christian Kamm	f502a526fa	Generalize Result<> class, add Optional<> ... To make it nicer to use outside of HTTP results.	2020-12-15 10:58:24 +01:00
Christian Kamm	96f4fd46e5	vfs: Make some behaviors suffix-vfs specific	2020-12-15 10:58:23 +01:00
Christian Kamm	90827c8162	vfs: Allow remote renames to propagate as such	2020-12-15 10:58:22 +01:00
Christian Kamm	bee1b0edd4	vfs: Implement dehydration tagging	2020-12-15 10:58:22 +01:00
Christian Kamm	ae9a7e088f	vfs: Fix suffix detection and handling	2020-12-15 10:58:22 +01:00
Christian Kamm	0f2ef42ba2	Fixes after rebase to master ... - use vfs suffix in ProcessDirectoryJob - fix include vfs.h - fix local vio passing vfs - fix checksum computation - vfs mode use - mingw lambda compile issue	2020-12-15 10:58:21 +01:00
Christian Kamm	22e08cf6ad	Checksums: Work on QIODevice*s ... Needed for cfapi where we want to feed data through a custom device which retrieves data from the windows api.	2020-12-15 10:58:21 +01:00
Olivier Goffart	5e05b61d2f	csync_vio_locale: use QString for the path in opendir ... So we don't have to convert to utf8 and back again	2020-12-15 10:58:20 +01:00
Olivier Goffart	3c3619f99a	Exclude: do everything with QString wiuthout converting to char*	2020-12-15 10:58:19 +01:00
Olivier Goffart	164051b0c9	ProcessDirectoryJob::process: optimize so there is only one map	2020-12-15 10:58:19 +01:00
Olivier Goffart	69de2d5180	Sync: optimize by removing setFileRecordMetadata ... Inh most case we already have a record from before, so avoid doing a useless lookup in the database. In owncloudpropagator.cpp, directories do not have a checksum so no need to call a function that preserves it	2020-12-15 10:58:19 +01:00
Olivier Goffart	b79e57d1c1	Discovery: fix double emission of finished in case of error	2020-12-15 10:58:17 +01:00
Olivier Goffart	7061f31887	Discovery: Fix downloading files when database is used for local discovery ... This also fix the currently failling LockedFilesTest	2020-12-15 10:58:17 +01:00
Olivier Goffart	eb23776f16	Discovery: Fix renaming on windows ... buf.type is ItemFileSkip because csync_vio_local_stat does not set this field	2020-12-15 10:58:16 +01:00
Olivier Goffart	beee123c80	New Discovery: Fix trailing slash causing failure on windows	2020-12-15 10:58:16 +01:00
Christian Kamm	00edcf98a1	Discovery: Virtual file handling adjustments ... - adjust virtual file path handing - helpers for vfs suffix adding/removal - helpers for isDirectory/isVirtual on SyncJournalRecords - be clear about what PathTuple _local/_server mean	2020-12-15 10:58:14 +01:00
Olivier Goffart	58eaf9940a	Database: Add an index on the parent path ... So we can quickly query the items in a parent directory This uses a custom slite3 function, which means that when downgrading the client, or using another tool to add entries in the database, any insertion in the metadata table will produce an error: "unknown function: parent_hash()" (This will crash the client 2.5)	2020-12-15 10:58:13 +01:00
Christian Kamm	b431f4ef0c	Discovery: Fix log output for instructions	2020-12-15 10:58:13 +01:00
Christian Kamm	ce420d77a8	Discovery: Don't rebuild invalidFilname regex each call	2020-12-15 10:58:13 +01:00
Christian Kamm	113124cde5	Discovery: Introduce smaller functions	2020-12-15 10:58:13 +01:00
Christian Kamm	4f6f706f40	Excludes: drop csyncTraversalMatchFun() ... The new discovery can call the traversal match function directly.	2020-12-15 10:58:13 +01:00
Christian Kamm	d1aedcfd3c	Discovery: restructure processFileAnalyzeLocalInfo	2020-12-15 10:58:10 +01:00
Christian Kamm	a2839bd40a	Discovery: easy conditions first in processFileAnalyzeRemoteInfo ... Removing two levels of indent that way	2020-12-15 10:58:10 +01:00
Christian Kamm	76341904e9	Discovery: Add comments	2020-12-15 10:58:10 +01:00
Olivier Goffart	5a1c93d0ac	Discovery: make sure finished is not called twice, even in case of errors	2020-12-15 10:58:10 +01:00
Olivier Goffart	f666511a4b	Discovery: Remove stale DB entries ... And test the Remove/Remove case. This means we need to always query the database for all the entries. This showed another small bug in the test in which sync item for virtual files at the root could have a slash in front of them.	2020-12-15 10:58:10 +01:00
Olivier Goffart	aa18e10ff5	Discovery: cleanups and comments	2020-12-15 10:58:09 +01:00
Olivier Goffart	b10b3e5eeb	Discovery: move checkMovePermissions to its own function	2020-12-15 10:58:09 +01:00
Olivier Goffart	edd866b32b	Discovery: Adjust the instruction in case of resolved conflict ... When resolving a conflict because the file was just updated on the server, we write all the metadata on the database immediatly, so INSTRUCITON_NONE is enough and UPDATE_METADATA is not needed	2020-12-15 10:58:09 +01:00
Olivier Goffart	7cddaf82ab	ProcessDirectoryJob: always set _childModified to true, regardless the direction ... This was like that to handle the case of CSYNC_INSTRUCTION_TYPE_CHANGE, but just add a condition in this location.	2020-12-15 10:58:09 +01:00
Olivier Goffart	46510c2f39	Discovery phase: refactor some code in DiscoveryPhase::findAndCancelDeletedJob ... Less code duplication	2020-12-15 10:58:09 +01:00
Olivier Goffart	1c2a3279bb	New Discovery Algorithm: more cleanups ... - rename progress() to be more explicit - Make some more member of the discovery phase private	2020-12-15 10:58:09 +01:00
Olivier Goffart	afed46afcc	New discovery algorithm: Parallel PROPFIND	2020-12-15 10:58:08 +01:00
Olivier Goffart	35c0cf4e59	New discovery algorithm: Set the originalFile for ignored files ... This is used to show the name in the UI	2020-12-15 10:58:08 +01:00
Olivier Goffart	52dcfcb166	New Propagation algorithm: Fetch, and emit, the root etag ... Remove the feature to concatenate etags as servers that don't have a root etag are no longer suported	2020-12-15 10:58:07 +01:00
Olivier Goffart	d25d87e92c	New Discovery Algorithm: Ge tthe size of new folders ... Also add a test that this works properly	2020-12-15 10:58:07 +01:00
Olivier Goffart	ef542ac83d	New Discovery algorithm: Split the process function even further ... Move the finialization in its own function. This allow to save a bit of code duplication. Also change the order of the parameter in the constructor for consistency	2020-12-15 10:58:07 +01:00
Olivier Goffart	fc69dda246	New Discovery Algo: Refactor by splitting the processFile in two	2020-12-15 10:58:07 +01:00
Olivier Goffart	b7d827d6d0	New Discovery Algorithm: Handle rename of virtual files	2020-12-15 10:58:07 +01:00