Commit Graph
13676 Commits
Author SHA1 Message Date
John Colvin 85dbee2f00 Fix typo in market_data.conf 2024-10-30 19:35:06 +00:00
John Colvin 14232f5644 Add BTC and ETH to VENUE_SIM in symbols.conf 2024-10-30 19:35:06 +00:00
John Colvin 89d49cd721 fix: Resolve main logging dir in new SparkDataDirectory class 2024-10-30 19:35:05 +00:00
John Colvin 590bc1749a refactor: Replace if/else with switch cases 2024-10-30 19:35:05 +00:00
John Colvin 339767a51f fix: Resolve onixs log & data dirs relative to app data root
When our logging code moved to lib_system, it lost access to the config
system. As a result, the "log_path" function, which was used by ICEMain
and MDP3Main, broke. I added a new class, SparkDataDirectory, to be the
central/common authority on paths to local storage.
2024-10-30 19:35:05 +00:00
John Colvin 47f2f16cd3 cleanup: Remove over-engineered subcommands
We don't need explicit subcommands to 'run onixs' md (just use config).
2024-10-30 19:35:05 +00:00
John Colvin d1b28a86c8 fix: Ensure IDGenerator instance is created before deref 2024-10-30 19:35:05 +00:00
John Colvin 50e7ad925e fix: Expand undefined vars to empty string
Bugs (fixed):
  * Md shared memory file names have unexpanded variable: '${BTS_SHARED_MEMORY_PREFIX}'
2024-10-30 19:35:05 +00:00
John Colvin 132201d2cf fix: Emplace MDConsumerHandle instead of copy assign 2024-10-30 19:35:05 +00:00
John Colvin 5543725ee2 Generate c++ protos w/ relative paths
We shouldn't be generating protos defined outside of the current CMakeLists.txt dir.
2024-10-30 19:35:05 +00:00
John Colvin 9c535616df fix build: Make venue conversion constexpr 2024-10-30 19:35:05 +00:00
John Colvin 1dd2db41f2 build: Use new/robust init_library fn in lib_domain 2024-10-30 19:35:05 +00:00
John Colvin a451c3e880 refactor: Move config services to lib_system
The proto files are still in lib_spark, w/ the exception of
system_config.proto, since that is a dep of ConfigurationState.
2024-10-30 19:35:05 +00:00
John Colvin 5485cc9c4f refactor: Move logging into lib_system
This is a fundamental part of our application suite, so system seems
like a sensible home.

Also moved a few logging deps (to lib_system):
* bts_chrono.h
* bts_no_copy.h
* defer.h
* dispatcher.h/cpp
* file_utils.h/cpp
* type_name.h
2024-10-30 19:35:05 +00:00
John Colvin 5e7e20df5a build: Move http code into its own lib 2024-10-30 19:35:05 +00:00
John Colvin 28f5181585 refactor: Move thread_manager to lib_system 2024-10-30 19:35:05 +00:00
John Colvin 5e7a478bf5 build (linux): Migrate catch2 dep to vcpkg (from externals) 2024-10-30 19:35:05 +00:00
John Colvin 0abc386d71 build (linux): Migrate fmt dep to vcpkg (from externals)
Now both linux and windows use vcpkg's fmt
2024-10-30 19:35:05 +00:00
John Colvin 53b040342a cleanup: Remove unnecessary includes 2024-10-30 19:31:41 +00:00
John Colvin e85f669534 refactor: Move threads.proto to lib_system 2024-10-30 19:31:41 +00:00
John Colvin 935d414b7f refactor: Move warn_ctrl.h into lib_system
This is another logging dep
2024-10-30 19:31:41 +00:00
John Colvin 89f4fe88f9 build: Link boost_filesystem in lib_system 2024-10-30 19:31:41 +00:00
John Colvin 161e0a8c3b refactor: Move os.h/cpp and deps to lib_system
This is a prerequisite for the next objective: move logging into its own lib.
As logging is a core dependency for so much of our system, this will enable
us to move more complex services (like md providers) into smaller libs.
2024-10-30 19:31:41 +00:00
John Colvin f5a6dc7a88 cleanup: Remove unused code 2024-10-30 19:31:41 +00:00
John Colvin 298a2f0617 cleanup: Remove more unnecessary includes 2024-10-30 19:31:41 +00:00
John Colvin c6fc1a0f89 refactor: Move SecurityMarketDataStatistics to lib_domain 2024-10-30 19:31:41 +00:00
John Colvin 6cd7baf903 cleanup: Remove unnecessary code 2024-10-30 19:31:41 +00:00
John Colvin 7d7621d832 cleanup: Remove empty header FTXSecurity.h 2024-10-30 19:31:41 +00:00
John Colvin ef8e4c4998 cleanup: Remove temporary redirect headers
These were used to make code migration smoother (to the new lib_system and lib_domain)

* spark/algorithm/TryCatch.h -> system/algorithm/try_catch.h
* spark/core/BoolName.h -> system/bool_name.h
* spark/core/EnumMacros.h -> system/enum_macros.h
* spark/core/FMT.h -> system/FMT.h
* spark/core/FMT_IMPL.h -> system/FMT_IMPL.h
* spark/core/TimeSpan.h -> system/time_span.h
* spark/core/TimeStamp.h -> system/time_stamp.h
* spark/domain/Price.h -> domain/price.h
* spark/io/JsonReader.h -> system/json/json_reader.h
* spark/io/JsonDumper.h -> system/json/json_dumper.h
2024-10-30 19:31:41 +00:00
John Colvin ad2e631bbc refactor: Move RFQ to lib_domain 2024-10-30 19:31:41 +00:00
John Colvin dccc9f0099 refactor: Move AggressorSide proto to lib_domain
Get rid of non-proto AggressorSide enum while we're at it (consolidate to 1 type)
2024-10-30 19:31:41 +00:00
John Colvin bab5eb4c70 cleanup: Remove more unused code 2024-10-30 19:31:41 +00:00
John Colvin e0608c3791 refactor: Move a few Order types to lib_domain 2024-10-30 19:31:41 +00:00
John Colvin e69c4782b5 refactor: Move TimeInForce to lib_domain 2024-10-30 19:31:41 +00:00
John Colvin 7ab045b120 cleanup: Remove unused code 2024-10-30 19:31:41 +00:00
John Colvin 9bd4bc421d refactor: Move TradeRecord into lib_domain 2024-10-30 19:31:41 +00:00
John Colvin 8b90debdd0 refactor: Move TradingStatus enum to lib_domain 2024-10-30 19:31:41 +00:00
John Colvin dc2e8b114a build: Update webpack-cli in admin webapp 2024-10-30 19:31:41 +00:00
John Colvin e064ab0433 build: Configure admin webapp build entirely in CMakeLists
Get rid of build_admin_web_app.py
2024-10-30 19:31:41 +00:00
John Colvin 42a9edbee3 refactor: Move domain types into new lib_domain
Also rename files in snake_case (standard naming convention for protos)
https://protobuf.dev/programming-guides/style/
2024-10-30 19:31:41 +00:00
John Colvin 92ea362d1e refactor: Move collections into lib_system 2024-10-30 19:31:41 +00:00
John Colvin 750228355a refactor: Move a handful of types/utils to lib_system 2024-10-30 19:31:41 +00:00
John Colvin 930c5e1187 build: Add preset to build with 6 jobs (-j 6)
Otherwise the devcontainer may hog too much cpu and cause the container to freeze
2024-10-30 19:31:41 +00:00
John Colvin b286f81067 cleanup: Remove unused includes
Mostly collection macro headers
2024-10-30 19:31:41 +00:00
John Colvin 36795bd851 cleanup (build): Move protobuf service generation cmake into lib_spark
Because lib_spark owns all the services
2024-10-30 19:31:41 +00:00
John Colvin 857702fae7 refactor: Rename protobuf out dir "include" -> "protobufs"
This is a more accurate and precise name. The dir contains c++ code generated
from .proto files - both sources (.cc) and headers (.pb.h).
2024-10-30 19:31:41 +00:00
John Colvin 2702d0d32e refactor: Move ValueWrapper into lib_system
So other projects can use it
2024-10-30 19:31:40 +00:00
John Colvin 10e78b5e20 Include bts_assert.h in bts_fatal.h
We shouldn't have to include bts_assert.h when we're already including bts_fatal.h
2024-10-30 19:31:40 +00:00
John Colvin 74027fc9cc refactor: Split MarketDataGateway up into providers/sources
MarketDataGateway still exists, but is greatly simplified. It creates
several `IMarketDataProvider`s, each of which generates a list of
`IMarketDataSource`s. The market data sources provide market data to an
`IMarketDataListener`.

* EmumbaMarketDataProvider
* CCApiMarketDataProvider
* PyMarketDataProvider
* OnixsMarketDataProvider
* ReplayMarketDataProvider

As a side effect, individual py market data sources are now explicitly
limited to a single venue (it probably should have been this way all
along, since the shared memory writers do not expect updates to involve
multiple venues).
2024-10-30 19:31:40 +00:00
John Colvin af5af01b39 cleanup: Remove superfluous code 2024-10-30 19:31:40 +00:00