Commit Graph
13727 Commits
Author SHA1 Message Date
John Colvin 1ea17a2a4e build: Replace global include/link dirs w/ target-specific calls
In other words, migrate "include_directories" and "link_directories" calls in the
root CMakeLists.txt to "target_include_directories" and "target_link_directories"
calls in InitLibrary.cmake
2024-11-26 18:40:34 +00:00
John Colvin e68f6d5eb1 fix build: Remove unused refs
Sparkd release builds were failing with warnings-as-errors about unused refs
2024-11-26 18:40:34 +00:00
John Colvin 6bc397b497 Fix eslint config and use modern flat style
https://eslint.org/docs/latest/use/configure/configuration-files#configuration-file
2024-11-26 18:40:34 +00:00
John Colvin 343af5d8a3 cleanup: Move global var into function scope in vite cfg 2024-11-26 18:40:34 +00:00
John Colvin ff8727b92d Update node pkgs in datastream webapp 2024-11-26 18:40:34 +00:00
John Colvin 5d85dfa197 cleanup (build): Remove unused cmake cache var 2024-11-26 18:40:34 +00:00
John Colvin 842740ceb3 Put cme config url in GlbxMarketDataConfig proto
Instead of using magic strings
2024-11-26 18:40:27 +00:00
John Colvin 79894864a0 refactor: Change raw IDGenerator ptr to shared_ptr 2024-11-26 18:19:43 +00:00
John Colvin f3021651eb fix: Actually use include/exclude params in SymbolLoader 2024-11-26 18:08:44 +00:00
John Colvin 459b808f4a fix build: Remove unnecessary link lib ssl 2024-11-26 17:31:45 +00:00
John Colvin 49497c9be5 refactor: Replace ConfigDownloader w/ lib_http fns
Essentially all it did was fetch config files via http GET. I ported some http
fns over from the cme-websocket-connector repo, which uses curlpp instead of
curl, and also supports async requests (coroutines) via the 'concurrencpp'

https://github.com/David-Haim/concurrencpp
2024-11-26 16:45:22 +00:00
John Colvin 585524a8b2 cleanup: Get rid of another Security type aliases 2024-11-26 16:45:20 +00:00
John Colvin c46771e8b6 cleanup: Remove unused code in Security.h/cpp 2024-11-26 16:38:29 +00:00
John Colvin 244fc647fb Fix typo in 'Quantity' FMT_IMPL
I didn't realize the "value()" function rounded out the decimal,
so I replaced it with a call to "full_value()".
2024-11-26 16:35:35 +00:00
John Colvin 57d7b4ba50 diag: Log when an MDProducer is created 2024-11-26 16:35:30 +00:00
John Colvin 97e4276e20 diag: Add logs around synthetic security discovery in MDConsumer 2024-11-26 16:32:09 +00:00
John Colvin d947882b0e refactor: Break shared mem md code up into smaller files
For easier reading/navigation
2024-11-26 16:32:09 +00:00
John Colvin 61479c1198 refactor: Break md relay/query server code up into smaller files
To make code navigation easier. This was a difficulty which I recently
confronted, while investigating a bug that prevented synthetics from
showing up the ui.
2024-11-26 16:32:09 +00:00
John Colvin 1871358bde refactor: Get rid of 'TimeStamp' typedef in MDStructure.h
Before this commit, we had 4 different TimeStamp types/identifiers, which is
confusing enough as it is:

* bts::core::TimeStamp
  - in system/time_stamp.h
* bts::utils::TimeStamp
  - in spark/utils/TimeStamp.h
* bts::TimeStamp
  - in system/bts_chrono.h
  - alias for std::chrono::system_clock::time_point
* bts::md::TimeStamp
  - in spark/md/Shm/MDStructure.h
  - alias for bts::utils::TimeStamp
  - removed in this commit

Additional aliases for these TimeStamps only adds to the confusion (esp
when the alias comes from a nested include).
2024-11-26 16:32:09 +00:00
John Colvin 8bdf899da8 refactor: Change refs/raw ptrs to smart ptrs in md gateway 2024-11-26 16:27:01 +00:00
John Colvin 63c400543f Fix typo in market_data.conf 2024-11-26 16:12:27 +00:00
John Colvin 6a339c273e Add BTC and ETH to VENUE_SIM in symbols.conf 2024-11-26 16:12:27 +00:00
John Colvin 16fc526b92 fix: Resolve main logging dir in new SparkDataDirectory class 2024-11-26 16:12:27 +00:00
John Colvin 8f8e0a8b8e refactor: Replace if/else with switch cases 2024-11-26 16:12:27 +00:00
John Colvin 36fa0a8237 fix: Resolve onixs log & data dirs relative to app data root
When our logging code moved to lib_system, it lost access to the config
system. As a result, the "log_path" function, which was used by ICEMain
and MDP3Main, broke. I added a new class, SparkDataDirectory, to be the
central/common authority on paths to local storage.
2024-11-26 16:12:25 +00:00
John Colvin 9abd1e68f2 cleanup: Remove over-engineered subcommands
We don't need explicit subcommands to 'run onixs' md (just use config).
2024-11-26 15:35:49 +00:00
John Colvin de56bd3237 fix: Ensure IDGenerator instance is created before deref 2024-11-26 15:35:49 +00:00
John Colvin 47712b704a fix: Expand undefined vars to empty string
Bugs (fixed):
  * Md shared memory file names have unexpanded variable: '${BTS_SHARED_MEMORY_PREFIX}'
2024-11-26 15:35:49 +00:00
John Colvin 6cf2b5fed2 fix: Emplace MDConsumerHandle instead of copy assign 2024-11-26 15:35:49 +00:00
John Colvin e2fe3a04ce Generate c++ protos w/ relative paths
We shouldn't be generating protos defined outside of the current CMakeLists.txt dir.
2024-11-26 15:35:49 +00:00
John Colvin 7aafc1b35e fix build: Make venue conversion constexpr 2024-11-26 15:35:49 +00:00
John Colvin 0165952b69 build: Use new/robust init_library fn in lib_domain 2024-11-26 15:35:49 +00:00
John Colvin bc9e07a287 refactor: Move config services to lib_system
The proto files are still in lib_spark, w/ the exception of
system_config.proto, since that is a dep of ConfigurationState.
2024-11-26 15:35:49 +00:00
John Colvin 67a5f6fea2 refactor: Move logging into lib_system
This is a fundamental part of our application suite, so system seems
like a sensible home.

Also moved a few logging deps (to lib_system):
* bts_chrono.h
* bts_no_copy.h
* defer.h
* dispatcher.h/cpp
* file_utils.h/cpp
* type_name.h
2024-11-26 14:44:51 +00:00
John Colvin 5e374fcb56 build: Move http code into its own lib 2024-11-26 14:12:29 +00:00
John Colvin 639be9c210 refactor: Move thread_manager to lib_system 2024-11-26 04:33:05 +00:00
John Colvin 62e82dbc42 build (linux): Migrate catch2 dep to vcpkg (from externals) 2024-11-26 04:33:05 +00:00
John Colvin 6fa1aa036f build (linux): Migrate fmt dep to vcpkg (from externals)
Now both linux and windows use vcpkg's fmt
2024-11-26 04:33:05 +00:00
John Colvin 92e825a73c cleanup: Remove unnecessary includes 2024-11-26 04:33:05 +00:00
John Colvin f12fa9c524 refactor: Move threads.proto to lib_system 2024-11-26 04:33:05 +00:00
John Colvin a412f96701 refactor: Move warn_ctrl.h into lib_system
This is another logging dep
2024-11-26 04:33:05 +00:00
John Colvin ee4308cb73 build: Link boost_filesystem in lib_system 2024-11-26 04:33:05 +00:00
John Colvin 5af3b094fa refactor: Move os.h/cpp and deps to lib_system
This is a prerequisite for the next objective: move logging into its own lib.
As logging is a core dependency for so much of our system, this will enable
us to move more complex services (like md providers) into smaller libs.
2024-11-26 04:33:05 +00:00
John Colvin f18d00fd80 cleanup: Remove unused code 2024-11-25 21:37:29 +00:00
John Colvin acb2bb7c1b cleanup: Remove more unnecessary includes 2024-11-25 21:37:29 +00:00
John Colvin 56ca93c9d9 refactor: Move SecurityMarketDataStatistics to lib_domain 2024-11-25 21:37:29 +00:00
John Colvin 2c711a1224 cleanup: Remove unnecessary code 2024-11-25 21:37:29 +00:00
John Colvin 12bffe1cd4 cleanup: Remove empty header FTXSecurity.h 2024-11-25 21:37:29 +00:00
John Colvin b6d7111f2d cleanup: Remove temporary redirect headers
These were used to make code migration smoother (to the new lib_system and lib_domain)

* spark/algorithm/TryCatch.h -> system/algorithm/try_catch.h
* spark/core/BoolName.h -> system/bool_name.h
* spark/core/EnumMacros.h -> system/enum_macros.h
* spark/core/FMT.h -> system/FMT.h
* spark/core/FMT_IMPL.h -> system/FMT_IMPL.h
* spark/core/TimeSpan.h -> system/time_span.h
* spark/core/TimeStamp.h -> system/time_stamp.h
* spark/domain/Price.h -> domain/price.h
* spark/io/JsonReader.h -> system/json/json_reader.h
* spark/io/JsonDumper.h -> system/json/json_dumper.h
2024-11-25 21:37:29 +00:00
John Colvin 4113b02fb4 refactor: Move RFQ to lib_domain 2024-11-25 21:18:43 +00:00