Commit Graph
13727 Commits
Author SHA1 Message Date
John Colvin ccc71c5a65 Put cme config url in GlbxMarketDataConfig proto
Instead of using magic strings
2024-11-29 15:05:12 +00:00
John Colvin 5604eabde4 refactor: Change raw IDGenerator ptr to shared_ptr 2024-11-29 15:05:12 +00:00
John Colvin 869f629d3f fix: Actually use include/exclude params in SymbolLoader 2024-11-29 15:05:12 +00:00
John Colvin 83879425e3 fix build: Remove unnecessary link lib ssl 2024-11-29 15:05:12 +00:00
John Colvin 718524b519 refactor: Replace ConfigDownloader w/ lib_http fns
Essentially all it did was fetch config files via http GET. I ported some http
fns over from the cme-websocket-connector repo, which uses curlpp instead of
curl, and also supports async requests (coroutines) via the 'concurrencpp'

https://github.com/David-Haim/concurrencpp
2024-11-29 15:05:12 +00:00
John Colvin 5bc5515b78 cleanup: Get rid of another Security type aliases 2024-11-29 15:05:12 +00:00
John Colvin 298290550e cleanup: Remove unused code in Security.h/cpp 2024-11-29 15:05:12 +00:00
John Colvin ef62430011 Fix typo in 'Quantity' FMT_IMPL
I didn't realize the "value()" function rounded out the decimal,
so I replaced it with a call to "full_value()".
2024-11-29 15:05:12 +00:00
John Colvin d618387837 diag: Log when an MDProducer is created 2024-11-29 15:05:12 +00:00
John Colvin 7c11d7e57a diag: Add logs around synthetic security discovery in MDConsumer 2024-11-29 15:05:12 +00:00
John Colvin 85819b93fa refactor: Break shared mem md code up into smaller files
For easier reading/navigation
2024-11-29 15:05:12 +00:00
John Colvin f9161949a8 refactor: Break md relay/query server code up into smaller files
To make code navigation easier. This was a difficulty which I recently
confronted, while investigating a bug that prevented synthetics from
showing up the ui.
2024-11-29 15:05:12 +00:00
John Colvin 4be5fe7ee2 refactor: Get rid of 'TimeStamp' typedef in MDStructure.h
Before this commit, we had 4 different TimeStamp types/identifiers, which is
confusing enough as it is:

* bts::core::TimeStamp
  - in system/time_stamp.h
* bts::utils::TimeStamp
  - in spark/utils/TimeStamp.h
* bts::TimeStamp
  - in system/bts_chrono.h
  - alias for std::chrono::system_clock::time_point
* bts::md::TimeStamp
  - in spark/md/Shm/MDStructure.h
  - alias for bts::utils::TimeStamp
  - removed in this commit

Additional aliases for these TimeStamps only adds to the confusion (esp
when the alias comes from a nested include).
2024-11-29 15:05:12 +00:00
John Colvin 9699ee50a3 refactor: Change refs/raw ptrs to smart ptrs in md gateway 2024-11-29 15:05:12 +00:00
John Colvin 68e474bbdd Fix typo in market_data.conf 2024-11-29 15:05:12 +00:00
John Colvin 7639553aca Add BTC and ETH to VENUE_SIM in symbols.conf 2024-11-29 15:05:12 +00:00
John Colvin 7cc2a1ec3e fix: Resolve main logging dir in new SparkDataDirectory class 2024-11-29 15:05:12 +00:00
John Colvin 7c0d51411a refactor: Replace if/else with switch cases 2024-11-29 15:05:12 +00:00
John Colvin 1faef232aa fix: Resolve onixs log & data dirs relative to app data root
When our logging code moved to lib_system, it lost access to the config
system. As a result, the "log_path" function, which was used by ICEMain
and MDP3Main, broke. I added a new class, SparkDataDirectory, to be the
central/common authority on paths to local storage.
2024-11-29 15:05:12 +00:00
John Colvin 4e41721e33 cleanup: Remove over-engineered subcommands
We don't need explicit subcommands to 'run onixs' md (just use config).
2024-11-29 15:05:12 +00:00
John Colvin 258ace9043 fix: Ensure IDGenerator instance is created before deref 2024-11-29 15:05:11 +00:00
John Colvin d0f48ae0d9 fix: Expand undefined vars to empty string
Bugs (fixed):
  * Md shared memory file names have unexpanded variable: '${BTS_SHARED_MEMORY_PREFIX}'
2024-11-29 15:05:11 +00:00
John Colvin 00a9d74221 fix: Emplace MDConsumerHandle instead of copy assign 2024-11-29 15:05:11 +00:00
John Colvin a42017e592 Generate c++ protos w/ relative paths
We shouldn't be generating protos defined outside of the current CMakeLists.txt dir.
2024-11-29 15:05:11 +00:00
John Colvin 49ebe56e31 fix build: Make venue conversion constexpr 2024-11-29 15:05:11 +00:00
John Colvin 376906b756 build: Use new/robust init_library fn in lib_domain 2024-11-29 15:05:11 +00:00
John Colvin c99954e173 refactor: Move config services to lib_system
The proto files are still in lib_spark, w/ the exception of
system_config.proto, since that is a dep of ConfigurationState.
2024-11-29 15:05:11 +00:00
John Colvin 5dc09d3399 refactor: Move logging into lib_system
This is a fundamental part of our application suite, so system seems
like a sensible home.

Also moved a few logging deps (to lib_system):
* bts_chrono.h
* bts_no_copy.h
* defer.h
* dispatcher.h/cpp
* file_utils.h/cpp
* type_name.h
2024-11-29 15:05:11 +00:00
John Colvin cbf362ed0a build: Move http code into its own lib 2024-11-29 15:05:11 +00:00
John Colvin 5656b33d26 refactor: Move thread_manager to lib_system 2024-11-29 15:05:11 +00:00
John Colvin 5d7f8a0052 build (linux): Migrate catch2 dep to vcpkg (from externals) 2024-11-29 15:05:11 +00:00
John Colvin a74e80bdfb build (linux): Migrate fmt dep to vcpkg (from externals)
Now both linux and windows use vcpkg's fmt
2024-11-29 15:05:11 +00:00
John Colvin 5040dd5e0c cleanup: Remove unnecessary includes 2024-11-29 15:05:11 +00:00
John Colvin 9a9e3311f2 refactor: Move threads.proto to lib_system 2024-11-29 15:05:11 +00:00
John Colvin c786afdd4c refactor: Move warn_ctrl.h into lib_system
This is another logging dep
2024-11-29 15:05:11 +00:00
John Colvin c1146e814a build: Link boost_filesystem in lib_system 2024-11-29 15:05:11 +00:00
John Colvin fd5d9ab7d3 refactor: Move os.h/cpp and deps to lib_system
This is a prerequisite for the next objective: move logging into its own lib.
As logging is a core dependency for so much of our system, this will enable
us to move more complex services (like md providers) into smaller libs.
2024-11-29 15:05:11 +00:00
John Colvin 0b34f87f86 cleanup: Remove unused code 2024-11-29 15:05:11 +00:00
John Colvin f0ea3719cc cleanup: Remove more unnecessary includes 2024-11-29 15:05:11 +00:00
John Colvin 56f171724c refactor: Move SecurityMarketDataStatistics to lib_domain 2024-11-29 15:05:11 +00:00
John Colvin 9b705ec5e7 cleanup: Remove unnecessary code 2024-11-29 15:05:11 +00:00
John Colvin 342d1e8c6b cleanup: Remove empty header FTXSecurity.h 2024-11-29 15:05:11 +00:00
John Colvin e351e196ea cleanup: Remove temporary redirect headers
These were used to make code migration smoother (to the new lib_system and lib_domain)

* spark/algorithm/TryCatch.h -> system/algorithm/try_catch.h
* spark/core/BoolName.h -> system/bool_name.h
* spark/core/EnumMacros.h -> system/enum_macros.h
* spark/core/FMT.h -> system/FMT.h
* spark/core/FMT_IMPL.h -> system/FMT_IMPL.h
* spark/core/TimeSpan.h -> system/time_span.h
* spark/core/TimeStamp.h -> system/time_stamp.h
* spark/domain/Price.h -> domain/price.h
* spark/io/JsonReader.h -> system/json/json_reader.h
* spark/io/JsonDumper.h -> system/json/json_dumper.h
2024-11-29 15:05:11 +00:00
John Colvin 6bf89ef76f refactor: Move RFQ to lib_domain 2024-11-29 15:05:11 +00:00
John Colvin fae0e3af16 refactor: Move AggressorSide proto to lib_domain
Get rid of non-proto AggressorSide enum while we're at it (consolidate to 1 type)
2024-11-29 15:05:11 +00:00
John Colvin d47ccc9a9f cleanup: Remove more unused code 2024-11-29 15:05:11 +00:00
John Colvin df134aad68 refactor: Move a few Order types to lib_domain 2024-11-29 15:05:11 +00:00
John Colvin 372c54f089 refactor: Move TimeInForce to lib_domain 2024-11-29 15:05:11 +00:00
John Colvin 71863c2991 cleanup: Remove unused code 2024-11-29 15:05:11 +00:00
John Colvin 47cc33afc7 refactor: Move TradeRecord into lib_domain 2024-11-29 15:05:11 +00:00