225 Commits

Author SHA1 Message Date
e0e24b6498 Fix merge list when posdb is merging 2018-01-05 11:21:51 +01:00
809d7c9b0d Removed the msg5* parameter to Msg0::getList()
The caller-supplied msg5 instance was only used by Msg51 and apparently only for tiny memory optimizations.
2017-11-03 15:13:08 +01:00
2bec1728ea Rename m_hostId to m_myHostId 2017-10-13 13:03:08 +02:00
0ba041fc0f Use fileId instead of fileNum (which is an index info m_fileInfo) 2017-05-10 16:25:46 +02:00
644a62b488 Remove unused code 2017-05-09 10:57:40 +02:00
f69f6d9d4b Remove always false forceLocalIndexdb from Msg0::getList. Remove default args for Msg0::getList. 2017-05-08 16:01:19 +02:00
e797620783 Remove unused allowPageCache 2017-05-08 16:01:19 +02:00
f012b7bfa2 Remove unused maxCacheAge & addToCache from Msg0 & Msg51 2017-05-08 16:01:19 +02:00
5d83be6c4a Remove unused maxCacheAge from Msg5 2017-05-08 16:01:19 +02:00
63796110ae Remove unused retryNum from Msg5::getList 2017-05-08 16:01:19 +02:00
1c8be52e78 Remove unused cacheKeyPtr from Msg5::getList 2017-05-08 16:01:19 +02:00
aa65b0f874 Remove commented out code 2017-05-08 13:10:37 +02:00
a20cc2b93f Dropped unused 'syncPoint' parameter to Msg5::getList() 2017-05-08 12:59:06 +02:00
8c9a3ecbc9 Dropped unused 'syncPoint' parameter to Msg0::getList() 2017-05-08 12:46:03 +02:00
1d769203e7 Merge branch 'nomerge2' 2017-05-08 11:59:43 +02:00
45ad44939a Catch std::bad_alloc and not '...' 2017-05-07 20:51:33 +02:00
1c117d3aa1 Dropped PingInfo + PingServer entierely.
The remaining functionality of the pingserver was to ping normalt and "shotgun" IPs to determine the fastests and working network path. This is better done at L2/L3 or OS level - not in the application.

The email-sending functionality was dropped too. We recommend using 3rd-party tools for monitoring and statistics-collection/triggering.
2017-05-05 15:00:31 +02:00
b3f8fc889c Revert "Remove unused function"
This is used on nomerge2 branch

This reverts commit a35d266d04.
2017-04-05 12:01:49 +02:00
a35d266d04 Remove unused function 2017-04-05 10:39:37 +02:00
a39eb54ae7 Merge branch 'master' into nomerge2 2017-03-28 11:15:09 +02:00
6a911c9c22 Remove statsdb related config 2017-03-27 22:06:16 +02:00
5b13833655 Merge branch 'master' into nomerge2 2017-03-27 12:06:48 +02:00
acff2e8ada Moved Msg5::getTreeList() logic+code to new Rdb::getTreeList() 2017-03-27 12:05:42 +02:00
2cee927c6e Merge branch 'master' into nomerge2 2017-03-25 19:16:52 +01:00
be45454d0e Only verify index when it's a file merge 2017-03-25 19:13:58 +01:00
ea4b877068 Merge branch 'master' into nomerge2 2017-03-24 16:30:04 +01:00
d77b46c72f Rework record size estimation in Msg5::readList() 2017-03-24 16:29:49 +01:00
213cb460cd Merge branch 'master' into nomerge2 2017-03-22 20:46:44 +01:00
1778d66315 Remove statsdb 2017-03-22 20:46:28 +01:00
cd75798b5b Merge branch 'master' into nomerge2 2017-03-14 14:48:18 +01:00
91e1f599dd msg5/Msg3: don't log errors without LOG_ERROR/LOG_WARN 2017-03-14 14:48:01 +01:00
d4c150b761 Merge branch 'master' into nomerge2 2017-03-06 16:31:46 +01:00
dd160dfd47 Fix calls to RdbList::checkList_r() in currently #defined-away code 2017-03-06 14:54:23 +01:00
d554847dd7 All file merges should be done in the merge-thread pool (not just posdb) 2017-03-06 12:54:18 +01:00
a97e964554 Add thread pool for merging 2017-03-06 12:38:36 +01:00
4a9df34f76 Add thread pool for merging 2017-03-06 12:07:36 +01:00
eab379f3b5 Merge branch 'master' into nomerge2 2017-02-20 16:09:13 +01:00
f61099a764 Remove unused input args from Msg0::getList 2017-02-20 15:00:12 +01:00
69d48b7a94 Merge branch 'master' into nomerge2
Conflicts:
	Parms.cpp
2017-01-29 01:21:42 +01:00
4036f3f62f Always measure time in Msg5::getTreeList() 2017-01-26 11:30:21 +01:00
343079b974 Merge branch 'master' into nomerge2 2016-12-15 17:10:46 +01:00
f4baff1456 Remove quickpoll from Msg5 2016-12-15 11:40:39 +01:00
fcb874d022 Merge branch 'master' into nomerge2
Conflicts:
	Msg2.cpp
	Msg40.cpp
	XmlDoc.cpp
2016-12-12 14:04:46 +01:00
bdd8cb5338 #include clean up Query.h 2016-12-08 16:56:09 +01:00
4f9017056e Cleaned up paranoid sanity-checks 2016-11-24 14:51:37 +01:00
dab892fc05 Merge branch 'master' into nomerge2
Conflicts:
	JobScheduler.cpp
	JobScheduler.h
	Msg2.cpp
	Msg39.cpp
	Msg40.cpp
	UdpServer.cpp
	main.cpp
2016-11-15 12:13:43 +01:00
aba937780d Stop #including Conf.h from header files 2016-11-12 20:24:20 +01:00
d52dabc828 #include cleanup of Url.h 2016-11-12 20:01:44 +01:00
5a06b25687 Merge branch 'master' into nomerge2
Conflicts:
	Msg2.cpp
	Msg3.cpp
	Msg39.cpp
	Msg51.cpp
	RdbList.cpp
2016-11-03 17:36:50 +01:00
5825378da5 Use merge-space while merging
No more BigFile .part* deletion during a merge to preserve disk space. Instead MergeSpaceCoordinator is used for coordinating access to a large and possibly cheap storage with room for a whole resulting mergefile.
When a mrge file has been finished the reads are allowed from that and reads from the source files disallowed, which are then deleted. Then the file is renamed/moved from merge-space to regular collection storage using the 2-phase commit feature of GbMoveFile.cpp, and finally reads are done from the finished file.

Details:
  RdbBase: Use MergeSpaceCoordinator and merge space for temporary target merge file.
  RdbBase: better cleanup of crashed merges
  RdbBase: more mutex locing while manipulatin m_fileInfo array
  RdbBase: keep track of thraeds/jobs
  RdbMerge: ditto
  RdbMerge: Dont call file->chopHead()
  Msg5/Msg3: no more "compensate for merge" flag
  Msg3: Skip over RdbBase files that have reads disallowed
2016-10-31 18:16:40 +01:00