Mirrors/privacore-open-source-search-engine
1
0
Fork 1
mirror of https://github.com/privacore/open-source-search-engine.git synced 2025-06-23 23:46:07 -04:00
Code Issues Packages Projects Releases Wiki Activity

Commit Graph

  • 9fa5e0940f Fix compilation error Ai Lin Chia 2016-11-04 12:19:48 +01:00
  • d001eb8a05 Fix compilation error Ai Lin Chia 2016-11-04 10:57:19 +01:00
  • 62c93a5002 Remove unnecessary rebuild files Ai Lin Chia 2016-11-03 18:20:38 +01:00
  • eb689efbae Minor formatting changes Ai Lin Chia 2016-11-03 17:48:09 +01:00
  • 1ac479a267 Remove commented out code Ai Lin Chia 2016-11-03 17:47:35 +01:00
  • 8d05497a90 Restore g_conf.m_spideringEnabled when repair is done Ai Lin Chia 2016-11-03 17:47:02 +01:00
  • dfeafd51e9 Remove commented out codes Ai Lin Chia 2016-11-03 17:46:20 +01:00
  • 25831c85b1 Add more trace logs to RdbBase Ai Lin Chia 2016-11-03 17:45:20 +01:00
  • 6b72884696 Make sure generateIndex will write index even when it's empty. Ai Lin Chia 2016-11-03 17:41:56 +01:00
  • 9b841190ab Added SafeBuf::nullTerm4() hack, so we can assume no mod-character truncation in utf8 decoding functions Ivan Skytte Jørgensen 2016-11-03 18:17:51 +01:00
  • f2109ec9bf Changed StackBuf macro into a template Ivan Skytte Jørgensen 2016-11-03 18:10:30 +01:00
  • 5a06b25687 Merge branch 'master' into nomerge2 Ivan Skytte Jørgensen 2016-11-03 17:36:50 +01:00
  • 841a587d96 More documentation of RdbBase Ivan Skytte Jørgensen 2016-11-03 17:01:01 +01:00
  • 205d2d61a2 Added a bit of documentation of RdbBase Ivan Skytte Jørgensen 2016-11-03 16:57:38 +01:00
  • 2c0bbe3e4a Refactor out min-to-merge logic/calculation Ivan Skytte Jørgensen 2016-11-03 16:33:25 +01:00
  • 680376720c Made merge resumption more safe Ivan Skytte Jørgensen 2016-11-03 16:17:14 +01:00
  • 3ee0a40a3e Misc constness Ivan Skytte Jørgensen 2016-11-03 13:43:34 +01:00
  • 40a26026f1 Removed usleep() macro undef+define Ivan Skytte Jørgensen 2016-11-03 12:30:55 +01:00
  • 5b6c72c309 Simplified dumpTagdb() in main.cpp Ivan Skytte Jørgensen 2016-11-03 12:30:15 +01:00
  • a00ff71117 added trace log option to Phrases Brian Rasmusson 2016-11-03 12:26:58 +01:00
  • f187b50ffd added trace log option to Phrases Brian Rasmusson 2016-11-03 12:19:59 +01:00
  • 0a8bff7ada Simplify getKeySizeFromRdbId() Ivan Skytte Jørgensen 2016-11-03 12:13:52 +01:00
  • a6a6d8a1e3 Fix memory leak in error path of moveFile() Ivan Skytte Jørgensen 2016-11-03 11:50:00 +01:00
  • 7b3af9b542 Cater for secondary rdb during rebuild Ai Lin Chia 2016-11-03 11:18:13 +01:00
  • af46ee68f1 Ignore trashing -saved file if doesn't exist Ai Lin Chia 2016-11-02 15:54:59 +01:00
  • 0cde5b01ca Use own merge dir for unit test Ai Lin Chia 2016-11-02 14:37:43 +01:00
  • 1f0b75193d Only log when we need to save RdbIndex Ai Lin Chia 2016-11-02 14:27:26 +01:00
  • 19952c1735 Changes in logging. Log more debug information Ai Lin Chia 2016-11-02 14:26:58 +01:00
  • 1468c3f20d Call generateGlobalIndex before verifying file sharding. Ai Lin Chia 2016-11-02 14:26:30 +01:00
  • 499e8b32ec Remove check of kernel logs. We should have external monitoring of disk errors instead of bundling into gb. Ai Lin Chia 2016-11-02 14:25:41 +01:00
  • 13d6d27a1f Fix bug where wrong file may be moved to trash (0 byte file in merge dir, but we're trying to move file in collection dir) Ai Lin Chia 2016-11-02 12:38:57 +01:00
  • 672df7a2cf Fixed typo in variable name Ai Lin Chia 2016-11-02 12:31:37 +01:00
  • 3804d0db5e Corrected log messages. Log message & log level Ai Lin Chia 2016-11-02 12:22:56 +01:00
  • 72011577ef Code style changes Ai Lin Chia 2016-11-02 12:22:18 +01:00
  • 49ee45356c Use KEYNEG instead Ai Lin Chia 2016-11-02 11:45:31 +01:00
  • 604204f775 Use rdbid_t for rdbId instead of char Ai Lin Chia 2016-11-02 11:30:54 +01:00
  • bc69b3b012 Use warning instead of debug log Ai Lin Chia 2016-11-02 11:24:55 +01:00
  • 0bc14d24c0 Remove commented out code Ai Lin Chia 2016-11-02 11:15:15 +01:00
  • 72d975ace0 Cater for treeIndex after rebuild. (eg: trash & rename rebuilded tree index) Ai Lin Chia 2016-11-01 13:51:16 +01:00
  • 78a59ea37e Initialize more members in Conf Ivan Skytte Jørgensen 2016-11-02 14:58:29 +01:00
  • 646014244d Stop using 'shortcut' variables when they makes the code less clear and don't improve performance Ivan Skytte Jørgensen 2016-11-01 15:40:10 +01:00
  • bfc9211623 Fix tmpfs problem with GbCopyFile Ivan Skytte Jørgensen 2016-11-01 15:37:09 +01:00
  • 606eafb389 Revert "Fix tmpfs problem with GbCopyFile" Ivan Skytte Jørgensen 2016-11-01 15:35:52 +01:00
  • 333046c34a Fix tmpfs problem with GbCopyFile Ivan Skytte Jørgensen 2016-11-01 15:27:12 +01:00
  • e70f293c54 Bugfix if leftover merge file exist in merge directory Ivan Skytte Jørgensen 2016-11-01 15:03:25 +01:00
  • 7e62a4b4a7 Bugfix if leftover merge file exist in merge directory Ivan Skytte Jørgensen 2016-11-01 14:24:10 +01:00
  • fea6301df1 Bugfix if leftover merge file exist in merge directory Ivan Skytte Jørgensen 2016-11-01 14:17:21 +01:00
  • 5f5fcc16dd Work around unusual filesystems in moveFile() Ivan Skytte Jørgensen 2016-11-01 14:12:29 +01:00
  • 24dbff44c7 Don't allow dump-in-progress files to be read Ivan Skytte Jørgensen 2016-11-01 13:46:48 +01:00
  • 01aac813a6 Fix unittest compilation error Ai Lin Chia 2016-11-01 12:16:03 +01:00
  • ca0f5d52e6 Disable gcc suggestion warnings. Ai Lin Chia 2016-11-01 11:01:55 +01:00
  • b58ca512ae Add space in log Ai Lin Chia 2016-10-14 09:29:19 +02:00
  • c314f111ab Removed unnecessary RdbBase::m_a/m_x Ivan Skytte Jørgensen 2016-11-01 12:13:31 +01:00
  • c4876ebea6 do not init m_memtablesize in Mem::Mem Brian Rasmusson 2016-11-01 12:24:32 +01:00
  • 9c5dce0f7d Updated README.md with Python requirement Brian Rasmusson 2016-11-01 12:11:47 +01:00
  • 360ea3ec67 Updated readme with more platforms that work fine Ivan Skytte Jørgensen 2016-11-01 12:02:39 +01:00
  • 00c5bf4a50 Update README.md Brian Rasmusson 2016-10-31 22:23:20 +01:00
  • 789f6580ef Update README.md Brian Rasmusson 2016-10-31 21:09:52 +01:00
  • dd91610440 Update README.md Brian Rasmusson 2016-10-31 20:59:12 +01:00
  • a1a480afad Update README.md Brian Rasmusson 2016-10-31 20:55:22 +01:00
  • 9e07acbce9 changed Makefile so config=release-safe must be used to disable features unsafe for our production environment Brian Rasmusson 2016-10-31 20:54:21 +01:00
  • 5825378da5 Use merge-space while merging Ivan Skytte Jørgensen 2016-10-31 18:16:40 +01:00
  • 73e4008aaa Name variables tn/tp something more descriptive Ivan Skytte Jørgensen 2016-10-31 17:36:48 +01:00
  • c5eef932aa Comment cleanup in RdbBase.cpp Ivan Skytte Jørgensen 2016-10-31 17:33:16 +01:00
  • bd132b12a4 Make loop more sane Ivan Skytte Jørgensen 2016-10-31 17:12:07 +01:00
  • a51a62a5a9 more detailed display of scoring data on the terms page Brian Rasmusson 2016-10-31 17:13:47 +01:00
  • a7c9703694 Moved 'is file root(001) or tmp-root(000)?' logic from Msg5 to RdbBase Ivan Skytte Jørgensen 2016-10-31 15:11:56 +01:00
  • ecee5c7f0d Stop using 'shortcut' vairables when they makes the code less clear and don't improve performance Ivan Skytte Jørgensen 2016-10-31 13:42:32 +01:00
  • 6f4c7e63d7 Changed Process::m_mdoe into an enum Ivan Skytte Jørgensen 2016-10-31 11:51:56 +01:00
  • 5bad84aa52 Merge branch 'master' into nomerge2 Ivan Skytte Jørgensen 2016-10-31 11:31:03 +01:00
  • 7fa7e98eb8 Renamed RdbBase::getNumGlobalRecs() to estimateNumGlobalRecs because that is waht it does Ivan Skytte Jørgensen 2016-10-28 16:16:47 +02:00
  • 925afce804 Added rename+move method to BigFile Ivan Skytte Jørgensen 2016-10-28 15:43:31 +02:00
  • 6b31fa676d Renamed RdbBase::getListSize() to estimateListSize() because that is what it does Ivan Skytte Jørgensen 2016-10-28 15:34:41 +02:00
  • 074456a489 Extended the unlink/rename collision detection Ivan Skytte Jørgensen 2016-10-28 14:49:52 +02:00
  • 5ff5dd4b92 Changed thread accounting in BigFile to use a single counter instead of two Ivan Skytte Jørgensen 2016-10-28 14:46:46 +02:00
  • c23eaf9ddf #include cleanup of File.h Ivan Skytte Jørgensen 2016-10-28 14:12:25 +02:00
  • 4d01bda9e8 Removed permissions parameter from File::open() because it was only specified by BigFile.cpp and that used the same value as getFileCreationFlags() Ivan Skytte Jørgensen 2016-10-28 14:08:31 +02:00
  • b611979649 Removed commented-out explicit file permission flags Ivan Skytte Jørgensen 2016-10-28 14:03:33 +02:00
  • 6a8b8125b1 const-ptr in BigFile::write() Ivan Skytte Jørgensen 2016-10-28 13:57:33 +02:00
  • dea14912c7 Clean up temporary *.saving files in SafeBuf::safeSave() Ivan Skytte Jørgensen 2016-10-28 13:49:10 +02:00
  • 2d4ee501c2 More constness in SafeBuf Ivan Skytte Jørgensen 2016-10-28 13:43:40 +02:00
  • 7c97e45695 Use 2-phase move/rename in BigFile Ivan Skytte Jørgensen 2016-10-28 13:38:50 +02:00
  • 9ec536f8e2 Make BigFile async unlnk/rename more thread-safe (still a few potential race conditions left) Ivan Skytte Jørgensen 2016-10-27 17:22:01 +02:00
  • 14c01972a6 Removed unused BigFile::getSize() Ivan Skytte Jørgensen 2016-10-27 16:27:09 +02:00
  • ef5aebdbd8 Fixed or removed obsolete or wrong comments Ivan Skytte Jørgensen 2016-10-27 15:20:07 +02:00
  • 930a596238 Added comments for m_numParts/m_maxParts Ivan Skytte Jørgensen 2016-10-27 15:00:16 +02:00
  • bba72d40fd Added comments for m_numParts/m_maxParts Ivan Skytte Jørgensen 2016-10-27 14:56:25 +02:00
  • 00019750da Removed weird sanity check in BigFile:.addPart Ivan Skytte Jørgensen 2016-10-27 14:49:23 +02:00
  • 19ccaf4b33 Removed BigFile::m_tmpBaseBuf Ivan Skytte Jørgensen 2016-10-27 14:37:23 +02:00
  • 769aba563e Make more BigFile members private Ivan Skytte Jørgensen 2016-10-27 14:28:04 +02:00
  • 927f15af7c Removed g_lastDiskReadCompleted (only used for debugging and not thraed-safe) Ivan Skytte Jørgensen 2016-10-27 14:19:01 +02:00
  • 81f0af4205 Repair: use BigFile::anyOngoingUnlinksOrRenames() instead of direct access to global variable Ivan Skytte Jørgensen 2016-10-27 14:15:11 +02:00
  • 420973060a Let Msg3 use BigFile methods instead of field access Ivan Skytte Jørgensen 2016-10-27 14:11:52 +02:00
  • e933752889 Simplify BigFile Ivan Skytte Jørgensen 2016-10-27 14:09:20 +02:00
  • 55c4cc55a1 Simplify BigFile Ivan Skytte Jørgensen 2016-10-27 14:07:12 +02:00
  • cc208485b7 Changed BigFile::m_part into a local variable Ivan Skytte Jørgensen 2016-10-27 14:03:42 +02:00
  • aaca3718b3 Moved comment to correct place Ivan Skytte Jørgensen 2016-10-27 13:58:42 +02:00
  • bacc239572 #include cleanup of BigFile.h Ivan Skytte Jørgensen 2016-10-27 13:47:49 +02:00
  • 6aad2fb6d2 Dropped BigFile::m_tinyBuf and m_littleBuf Ivan Skytte Jørgensen 2016-10-27 13:26:44 +02:00
  • 5840d5eabc Removed obsolete comment Ivan Skytte Jørgensen 2016-10-27 12:36:56 +02:00