summaryrefslogtreecommitdiffstats
path: root/common/storage_lmdb.cpp
Commit message (Collapse)AuthorAge
* Nitpicksrange-query/storageMinijackson2018-05-24
|
* findAllInRange: Remove finding closest key to uppe bound ahead of timeMinijackson2018-05-24
|
* Add and test findAllInRange for ranged lookupsMinijackson2018-05-23
|
* Fixed use of mdb_dbi_openChristian Mollekopf2018-05-23
| | | | | | | | | | | | | | | | | | | | There can only ever be one transaction using mdb_dbi_open running, and that transaction must commit or abort before any other transaction attempts to use mdb_dbi_open. Use delayed dbi merging with write transactions and a temporary transaction for read transactions. We now protect dbi initialization with a mutex and immediately update the sDbis hash. This assumes that the created dbis are indeed We can still violate the only one transaction may use mdb_dbi_open rule if we start a read-only transaction after the write transaction, before the write transaction commits. It does not seem to be something we actually do though. Opening dbis on environment init is further separated out, so we don't end up in the regular openDatabase codepath at all.
* Actually close the lmdb environment before removing from disk.Christian Mollekopf2018-05-20
| | | | Otherwise removal doesn't work on windows due to open file handles.
* mdb_env_set_mapsize should be called after create but before openChristian Mollekopf2018-05-15
| | | | according to the docs.
* Try a bit harder to ensure that env always has a sane value.Christian Mollekopf2018-05-15
|
* Windows compatChristian Mollekopf2018-04-19
|
* Make sure we initialize the environment correctly and only set the db ↵Christian Mollekopf2018-03-26
| | | | version when creating it
* Don't just set the db version, only when we create the db first.Christian Mollekopf2018-03-26
|
* Optional printing of transaction spanChristian Mollekopf2018-01-30
|
* Use read-write locks for finer grained control to sDbi and sEnvironmentsChristian Mollekopf2018-01-03
| | | | | | | | | | There are only a few cases where have to access the list of dbis or environments, so we can normally get away with just read-locking. This seems to fix a segfault that was possibly caused be an environment being reused that has already been freed in another thread. The read-only lock when initially retrieving the environment seems to fix that.
* Trying to open a db that doesn't exist in read-only mode is not an errorChristian Mollekopf2018-01-03
|
* Print transaction spanChristian Mollekopf2017-11-21
|
* Storage debugging codeChristian Mollekopf2017-11-21
|
* Print key/value when put failsChristian Mollekopf2017-11-20
|
* Simplified codeChristian Mollekopf2017-07-16
| | | | The while loop is executed at least once, so advanced is always true.
* Better error messagesChristian Mollekopf2017-07-16
|
* initEnvironment with double-checked lockingChristian Mollekopf2017-05-11
|
* Starting to get rid of the SINK_DEBUG_AREAChristian Mollekopf2017-05-11
|
* A defined table layoutChristian Mollekopf2017-05-06
|
* Don't leak transactions when copying them.Christian Mollekopf2017-05-05
| | | | Previsouly we would hit the maxreaders limit
* Take sink down if we're not assertingChristian Mollekopf2017-05-04
|
* CleanupChristian Mollekopf2017-05-04
|
* Sanity check db namesChristian Mollekopf2017-05-03
| | | | | | lmdb and sink deal badly with e.g. a string containing a null in the millde as db name. Thus we try to protect better against it. This is an actual problem we triggered: https://phabricator.kde.org/T5880
* lmdb cleanupChristian Mollekopf2017-03-06
|
* Ensure we don't try to open db's that are not available to ourChristian Mollekopf2017-03-06
| | | | transaction.
* Less debug outputChristian Mollekopf2017-02-28
|
* Make opening dbis non-racyChristian Mollekopf2017-02-27
| | | | | | | | | | | | | | Dbis can only be opened by one thread and should then be shared accross all threads after committing the transaction to create the dbi. This requires us to initially open all db's, which in turn requires us to know the correct flags. This patch stores the flags to open each db in a separate db, and then opens up all databases on initial start. If a new database is created that dbi is as well shared as soon as the transaction is committed (before the dbi is private to the transaction).
* Attempt to fix the issue of opening the wrong databaseChristian Mollekopf2017-02-26
|
* Better debug outputChristian Mollekopf2017-02-24
|
* Bring the application down in a controlled fashion if we experience aChristian Mollekopf2017-02-23
| | | | critical error.
* Fixed index removalsChristian Mollekopf2017-02-13
|
* Fixed build issues with pedantic enabledChristian Mollekopf2017-01-12
|
* Copy command and proper moveChristian Mollekopf2016-12-04
|
* Refactor how the storage is used.Christian Mollekopf2016-10-21
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | This is the initial refactoring to improve how we deal with the storage. It does a couple of things: * Rename Sink::Storage to Sink::Storage::DataStore to free up the Sink::Storage namespace * Introduce a Sink::ResourceContext to have a single object that can be passed around containing everything that is necessary to operate on a resource. This is a lot better than the multiple separate parameters that we used to pass around all over the place, while still allowing for dependency injection for tests. * Tie storage access together using the new EntityStore that directly works with ApplicationDomainTypes. This gives us a central place where main storage, indexes and buffer adaptors are tied together, which will also give us a place to implement external indexes, such as a fulltextindex using xapian. * Use ApplicationDomainTypes as the default way to pass around entities. Instead of using various ways to pass around entities (buffers, buffer adaptors, ApplicationDomainTypes), only use a single way. The old approach was confusing, and was only done as: * optimization; really shouldn't be necessary and otherwise I'm sure we can find better ways to optimize ApplicationDomainType itself. * a way to account for entities that have multiple buffers, a concept that I no longer deem relevant. While this commit does the bulk of the work to get there, the following commits will refactor more stuff to get things back to normal.
* Replaced commented code with a comment.Christian Mollekopf2016-10-07
|
* Detect when we try to operate on transactions that point to aChristian Mollekopf2016-10-07
| | | | | | non-existing env. ...which happens if we remove the env while transactions are open.
* Support valgrind directly in the buildsystemChristian Mollekopf2016-07-11
|
* A new debug system.Christian Mollekopf2016-07-07
| | | | | | | | | | | | | | | Instead of a single #define as debug area the new system allows for an identifier for each debug message with the structure component.area. The component is a dot separated identifier of the runtime component, such as the process or the plugin. The area is the code component, and can be as such defined at compiletime. The idea of this system is that it becomes possible to i.e. look at the output of all messages in the query subsystem of a specific resource (something that happens in the client process, but in the resource-specific subcomponent). The new macros are supposed to be less likely to clash with other names, hence the new names.
* CleanupChristian Mollekopf2016-07-06
|
* Fixed a bunch of memory leaks.Christian Mollekopf2016-07-06
| | | | Found with valgrind
* Avoid unnecesary warningsChristian Mollekopf2016-06-26
|
* Skip internal keys by default while scanning.Christian Mollekopf2016-06-05
|
* Debug messagesChristian Mollekopf2016-05-31
|
* Detect and recover from invalid database environment.Christian Mollekopf2016-05-30
| | | | | | Sometimes wrong databases are returned for the name, probably related to threading/incorrect usage of lmdb. For the time being we recover from that by detecting it and retrying.
* Fixed genericresource so it works with the maildirresourcetestChristian Mollekopf2016-05-29
|
* Better error messages in storageChristian Mollekopf2016-05-28
|
* It's an error if we tried to read the latest value but didn't find any.Christian Mollekopf2016-05-24
|
* Fromatted the whole codebase with clang-format.Christian Mollekopf2016-03-03
| | | | clang-format -i */**{.cpp,.h}