Commit Graph
13709 Commits
Author SHA1 Message Date
John Colvin 1faef232aa fix: Resolve onixs log & data dirs relative to app data root
When our logging code moved to lib_system, it lost access to the config
system. As a result, the "log_path" function, which was used by ICEMain
and MDP3Main, broke. I added a new class, SparkDataDirectory, to be the
central/common authority on paths to local storage.
2024-11-29 15:05:12 +00:00
John Colvin 4e41721e33 cleanup: Remove over-engineered subcommands
We don't need explicit subcommands to 'run onixs' md (just use config).
2024-11-29 15:05:12 +00:00
John Colvin 258ace9043 fix: Ensure IDGenerator instance is created before deref 2024-11-29 15:05:11 +00:00
John Colvin d0f48ae0d9 fix: Expand undefined vars to empty string
Bugs (fixed):
  * Md shared memory file names have unexpanded variable: '${BTS_SHARED_MEMORY_PREFIX}'
2024-11-29 15:05:11 +00:00
John Colvin 00a9d74221 fix: Emplace MDConsumerHandle instead of copy assign 2024-11-29 15:05:11 +00:00
John Colvin a42017e592 Generate c++ protos w/ relative paths
We shouldn't be generating protos defined outside of the current CMakeLists.txt dir.
2024-11-29 15:05:11 +00:00
John Colvin 49ebe56e31 fix build: Make venue conversion constexpr 2024-11-29 15:05:11 +00:00
John Colvin 376906b756 build: Use new/robust init_library fn in lib_domain 2024-11-29 15:05:11 +00:00
John Colvin c99954e173 refactor: Move config services to lib_system
The proto files are still in lib_spark, w/ the exception of
system_config.proto, since that is a dep of ConfigurationState.
2024-11-29 15:05:11 +00:00
John Colvin 5dc09d3399 refactor: Move logging into lib_system
This is a fundamental part of our application suite, so system seems
like a sensible home.

Also moved a few logging deps (to lib_system):
* bts_chrono.h
* bts_no_copy.h
* defer.h
* dispatcher.h/cpp
* file_utils.h/cpp
* type_name.h
2024-11-29 15:05:11 +00:00
John Colvin cbf362ed0a build: Move http code into its own lib 2024-11-29 15:05:11 +00:00
John Colvin 5656b33d26 refactor: Move thread_manager to lib_system 2024-11-29 15:05:11 +00:00
John Colvin 5d7f8a0052 build (linux): Migrate catch2 dep to vcpkg (from externals) 2024-11-29 15:05:11 +00:00
John Colvin a74e80bdfb build (linux): Migrate fmt dep to vcpkg (from externals)
Now both linux and windows use vcpkg's fmt
2024-11-29 15:05:11 +00:00
John Colvin 5040dd5e0c cleanup: Remove unnecessary includes 2024-11-29 15:05:11 +00:00
John Colvin 9a9e3311f2 refactor: Move threads.proto to lib_system 2024-11-29 15:05:11 +00:00
John Colvin c786afdd4c refactor: Move warn_ctrl.h into lib_system
This is another logging dep
2024-11-29 15:05:11 +00:00
John Colvin c1146e814a build: Link boost_filesystem in lib_system 2024-11-29 15:05:11 +00:00
John Colvin fd5d9ab7d3 refactor: Move os.h/cpp and deps to lib_system
This is a prerequisite for the next objective: move logging into its own lib.
As logging is a core dependency for so much of our system, this will enable
us to move more complex services (like md providers) into smaller libs.
2024-11-29 15:05:11 +00:00
John Colvin 0b34f87f86 cleanup: Remove unused code 2024-11-29 15:05:11 +00:00
John Colvin f0ea3719cc cleanup: Remove more unnecessary includes 2024-11-29 15:05:11 +00:00
John Colvin 56f171724c refactor: Move SecurityMarketDataStatistics to lib_domain 2024-11-29 15:05:11 +00:00
John Colvin 9b705ec5e7 cleanup: Remove unnecessary code 2024-11-29 15:05:11 +00:00
John Colvin 342d1e8c6b cleanup: Remove empty header FTXSecurity.h 2024-11-29 15:05:11 +00:00
John Colvin e351e196ea cleanup: Remove temporary redirect headers
These were used to make code migration smoother (to the new lib_system and lib_domain)

* spark/algorithm/TryCatch.h -> system/algorithm/try_catch.h
* spark/core/BoolName.h -> system/bool_name.h
* spark/core/EnumMacros.h -> system/enum_macros.h
* spark/core/FMT.h -> system/FMT.h
* spark/core/FMT_IMPL.h -> system/FMT_IMPL.h
* spark/core/TimeSpan.h -> system/time_span.h
* spark/core/TimeStamp.h -> system/time_stamp.h
* spark/domain/Price.h -> domain/price.h
* spark/io/JsonReader.h -> system/json/json_reader.h
* spark/io/JsonDumper.h -> system/json/json_dumper.h
2024-11-29 15:05:11 +00:00
John Colvin 6bf89ef76f refactor: Move RFQ to lib_domain 2024-11-29 15:05:11 +00:00
John Colvin fae0e3af16 refactor: Move AggressorSide proto to lib_domain
Get rid of non-proto AggressorSide enum while we're at it (consolidate to 1 type)
2024-11-29 15:05:11 +00:00
John Colvin d47ccc9a9f cleanup: Remove more unused code 2024-11-29 15:05:11 +00:00
John Colvin df134aad68 refactor: Move a few Order types to lib_domain 2024-11-29 15:05:11 +00:00
John Colvin 372c54f089 refactor: Move TimeInForce to lib_domain 2024-11-29 15:05:11 +00:00
John Colvin 71863c2991 cleanup: Remove unused code 2024-11-29 15:05:11 +00:00
John Colvin 47cc33afc7 refactor: Move TradeRecord into lib_domain 2024-11-29 15:05:11 +00:00
John Colvin ffb1d9fd47 refactor: Move TradingStatus enum to lib_domain 2024-11-29 15:05:11 +00:00
John Colvin 340e91f164 build: Update webpack-cli in admin webapp 2024-11-29 15:05:11 +00:00
John Colvin 3fb0b420db build: Configure admin webapp build entirely in CMakeLists
Get rid of build_admin_web_app.py
2024-11-29 15:05:11 +00:00
John Colvin 7cc938d85e refactor: Move domain types into new lib_domain
Also rename files in snake_case (standard naming convention for protos)
https://protobuf.dev/programming-guides/style/
2024-11-29 15:05:11 +00:00
John Colvin f20e013e4e refactor: Move collections into lib_system 2024-11-29 15:05:11 +00:00
John Colvin bf9a6c3431 refactor: Move a handful of types/utils to lib_system 2024-11-29 15:05:11 +00:00
John Colvin f052c591eb build: Add preset to build with 6 jobs (-j 6)
Otherwise the devcontainer may hog too much cpu and cause the container to freeze
2024-11-29 15:05:11 +00:00
John Colvin 583cf0bb16 cleanup: Remove unused includes
Mostly collection macro headers
2024-11-29 15:05:11 +00:00
John Colvin bb72e1b8ad cleanup (build): Move protobuf service generation cmake into lib_spark
Because lib_spark owns all the services
2024-11-29 15:05:11 +00:00
John Colvin 5466058ef2 refactor: Rename protobuf out dir "include" -> "protobufs"
This is a more accurate and precise name. The dir contains c++ code generated
from .proto files - both sources (.cc) and headers (.pb.h).
2024-11-29 15:05:11 +00:00
John Colvin e98bb730e4 refactor: Move ValueWrapper into lib_system
So other projects can use it
2024-11-29 15:05:10 +00:00
John Colvin 1f9a67f912 Include bts_assert.h in bts_fatal.h
We shouldn't have to include bts_assert.h when we're already including bts_fatal.h
2024-11-29 15:05:10 +00:00
John Colvin ec0712b0cc refactor: Split MarketDataGateway up into providers/sources
MarketDataGateway still exists, but is greatly simplified. It creates
several `IMarketDataProvider`s, each of which generates a list of
`IMarketDataSource`s. The market data sources provide market data to an
`IMarketDataListener`.

* EmumbaMarketDataProvider
* CCApiMarketDataProvider
* PyMarketDataProvider
* OnixsMarketDataProvider
* ReplayMarketDataProvider

As a side effect, individual py market data sources are now explicitly
limited to a single venue (it probably should have been this way all
along, since the shared memory writers do not expect updates to involve
multiple venues).
2024-11-29 15:05:10 +00:00
John Colvin 6ea7774e5f cleanup: Remove superfluous code 2024-11-29 15:05:10 +00:00
John Colvin f2f2024562 improvement: Set SHARED_MEMORY_PREFIX to an environment variable
So we can effectively define it at runtime. We don't want to have to
produce different builds just to change the shared mem prefix.
2024-11-29 15:05:10 +00:00
John Colvin 25ea9fac1d fix: Always prepend proc name to shared mem prefix
Our shared memory model isn't really designed to be shared across processes.
Maybe some day it will.
2024-11-29 15:05:10 +00:00
John Colvin 98a6a357bd cleanup: Remove redundant macro def 2024-11-29 15:05:10 +00:00
John Colvin 62a4073748 Skip md recording thread loop if no recorders configured to run 2024-11-29 15:05:10 +00:00