John Colvin
1faef232aa
fix: Resolve onixs log & data dirs relative to app data root
...
When our logging code moved to lib_system, it lost access to the config
system. As a result, the "log_path" function, which was used by ICEMain
and MDP3Main, broke. I added a new class, SparkDataDirectory, to be the
central/common authority on paths to local storage.
2024-11-29 15:05:12 +00:00
John Colvin
4e41721e33
cleanup: Remove over-engineered subcommands
...
We don't need explicit subcommands to 'run onixs' md (just use config).
2024-11-29 15:05:12 +00:00
John Colvin
258ace9043
fix: Ensure IDGenerator instance is created before deref
2024-11-29 15:05:11 +00:00
John Colvin
d0f48ae0d9
fix: Expand undefined vars to empty string
...
Bugs (fixed):
* Md shared memory file names have unexpanded variable: '${BTS_SHARED_MEMORY_PREFIX}'
2024-11-29 15:05:11 +00:00
John Colvin
00a9d74221
fix: Emplace MDConsumerHandle instead of copy assign
2024-11-29 15:05:11 +00:00
John Colvin
a42017e592
Generate c++ protos w/ relative paths
...
We shouldn't be generating protos defined outside of the current CMakeLists.txt dir.
2024-11-29 15:05:11 +00:00
John Colvin
49ebe56e31
fix build: Make venue conversion constexpr
2024-11-29 15:05:11 +00:00
John Colvin
376906b756
build: Use new/robust init_library fn in lib_domain
2024-11-29 15:05:11 +00:00
John Colvin
c99954e173
refactor: Move config services to lib_system
...
The proto files are still in lib_spark, w/ the exception of
system_config.proto, since that is a dep of ConfigurationState.
2024-11-29 15:05:11 +00:00
John Colvin
5dc09d3399
refactor: Move logging into lib_system
...
This is a fundamental part of our application suite, so system seems
like a sensible home.
Also moved a few logging deps (to lib_system):
* bts_chrono.h
* bts_no_copy.h
* defer.h
* dispatcher.h/cpp
* file_utils.h/cpp
* type_name.h
2024-11-29 15:05:11 +00:00
John Colvin
cbf362ed0a
build: Move http code into its own lib
2024-11-29 15:05:11 +00:00
John Colvin
5656b33d26
refactor: Move thread_manager to lib_system
2024-11-29 15:05:11 +00:00
John Colvin
5d7f8a0052
build (linux): Migrate catch2 dep to vcpkg (from externals)
2024-11-29 15:05:11 +00:00
John Colvin
a74e80bdfb
build (linux): Migrate fmt dep to vcpkg (from externals)
...
Now both linux and windows use vcpkg's fmt
2024-11-29 15:05:11 +00:00
John Colvin
5040dd5e0c
cleanup: Remove unnecessary includes
2024-11-29 15:05:11 +00:00
John Colvin
9a9e3311f2
refactor: Move threads.proto to lib_system
2024-11-29 15:05:11 +00:00
John Colvin
c786afdd4c
refactor: Move warn_ctrl.h into lib_system
...
This is another logging dep
2024-11-29 15:05:11 +00:00
John Colvin
c1146e814a
build: Link boost_filesystem in lib_system
2024-11-29 15:05:11 +00:00
John Colvin
fd5d9ab7d3
refactor: Move os.h/cpp and deps to lib_system
...
This is a prerequisite for the next objective: move logging into its own lib.
As logging is a core dependency for so much of our system, this will enable
us to move more complex services (like md providers) into smaller libs.
2024-11-29 15:05:11 +00:00
John Colvin
0b34f87f86
cleanup: Remove unused code
2024-11-29 15:05:11 +00:00
John Colvin
f0ea3719cc
cleanup: Remove more unnecessary includes
2024-11-29 15:05:11 +00:00
John Colvin
56f171724c
refactor: Move SecurityMarketDataStatistics to lib_domain
2024-11-29 15:05:11 +00:00
John Colvin
9b705ec5e7
cleanup: Remove unnecessary code
2024-11-29 15:05:11 +00:00
John Colvin
342d1e8c6b
cleanup: Remove empty header FTXSecurity.h
2024-11-29 15:05:11 +00:00
John Colvin
e351e196ea
cleanup: Remove temporary redirect headers
...
These were used to make code migration smoother (to the new lib_system and lib_domain)
* spark/algorithm/TryCatch.h -> system/algorithm/try_catch.h
* spark/core/BoolName.h -> system/bool_name.h
* spark/core/EnumMacros.h -> system/enum_macros.h
* spark/core/FMT.h -> system/FMT.h
* spark/core/FMT_IMPL.h -> system/FMT_IMPL.h
* spark/core/TimeSpan.h -> system/time_span.h
* spark/core/TimeStamp.h -> system/time_stamp.h
* spark/domain/Price.h -> domain/price.h
* spark/io/JsonReader.h -> system/json/json_reader.h
* spark/io/JsonDumper.h -> system/json/json_dumper.h
2024-11-29 15:05:11 +00:00
John Colvin
6bf89ef76f
refactor: Move RFQ to lib_domain
2024-11-29 15:05:11 +00:00
John Colvin
fae0e3af16
refactor: Move AggressorSide proto to lib_domain
...
Get rid of non-proto AggressorSide enum while we're at it (consolidate to 1 type)
2024-11-29 15:05:11 +00:00
John Colvin
d47ccc9a9f
cleanup: Remove more unused code
2024-11-29 15:05:11 +00:00
John Colvin
df134aad68
refactor: Move a few Order types to lib_domain
2024-11-29 15:05:11 +00:00
John Colvin
372c54f089
refactor: Move TimeInForce to lib_domain
2024-11-29 15:05:11 +00:00
John Colvin
71863c2991
cleanup: Remove unused code
2024-11-29 15:05:11 +00:00
John Colvin
47cc33afc7
refactor: Move TradeRecord into lib_domain
2024-11-29 15:05:11 +00:00
John Colvin
ffb1d9fd47
refactor: Move TradingStatus enum to lib_domain
2024-11-29 15:05:11 +00:00
John Colvin
340e91f164
build: Update webpack-cli in admin webapp
2024-11-29 15:05:11 +00:00
John Colvin
3fb0b420db
build: Configure admin webapp build entirely in CMakeLists
...
Get rid of build_admin_web_app.py
2024-11-29 15:05:11 +00:00
John Colvin
7cc938d85e
refactor: Move domain types into new lib_domain
...
Also rename files in snake_case (standard naming convention for protos)
https://protobuf.dev/programming-guides/style/
2024-11-29 15:05:11 +00:00
John Colvin
f20e013e4e
refactor: Move collections into lib_system
2024-11-29 15:05:11 +00:00
John Colvin
bf9a6c3431
refactor: Move a handful of types/utils to lib_system
2024-11-29 15:05:11 +00:00
John Colvin
f052c591eb
build: Add preset to build with 6 jobs (-j 6)
...
Otherwise the devcontainer may hog too much cpu and cause the container to freeze
2024-11-29 15:05:11 +00:00
John Colvin
583cf0bb16
cleanup: Remove unused includes
...
Mostly collection macro headers
2024-11-29 15:05:11 +00:00
John Colvin
bb72e1b8ad
cleanup (build): Move protobuf service generation cmake into lib_spark
...
Because lib_spark owns all the services
2024-11-29 15:05:11 +00:00
John Colvin
5466058ef2
refactor: Rename protobuf out dir "include" -> "protobufs"
...
This is a more accurate and precise name. The dir contains c++ code generated
from .proto files - both sources (.cc) and headers (.pb.h).
2024-11-29 15:05:11 +00:00
John Colvin
e98bb730e4
refactor: Move ValueWrapper into lib_system
...
So other projects can use it
2024-11-29 15:05:10 +00:00
John Colvin
1f9a67f912
Include bts_assert.h in bts_fatal.h
...
We shouldn't have to include bts_assert.h when we're already including bts_fatal.h
2024-11-29 15:05:10 +00:00
John Colvin
ec0712b0cc
refactor: Split MarketDataGateway up into providers/sources
...
MarketDataGateway still exists, but is greatly simplified. It creates
several `IMarketDataProvider`s, each of which generates a list of
`IMarketDataSource`s. The market data sources provide market data to an
`IMarketDataListener`.
* EmumbaMarketDataProvider
* CCApiMarketDataProvider
* PyMarketDataProvider
* OnixsMarketDataProvider
* ReplayMarketDataProvider
As a side effect, individual py market data sources are now explicitly
limited to a single venue (it probably should have been this way all
along, since the shared memory writers do not expect updates to involve
multiple venues).
2024-11-29 15:05:10 +00:00
John Colvin
6ea7774e5f
cleanup: Remove superfluous code
2024-11-29 15:05:10 +00:00
John Colvin
f2f2024562
improvement: Set SHARED_MEMORY_PREFIX to an environment variable
...
So we can effectively define it at runtime. We don't want to have to
produce different builds just to change the shared mem prefix.
2024-11-29 15:05:10 +00:00
John Colvin
25ea9fac1d
fix: Always prepend proc name to shared mem prefix
...
Our shared memory model isn't really designed to be shared across processes.
Maybe some day it will.
2024-11-29 15:05:10 +00:00
John Colvin
98a6a357bd
cleanup: Remove redundant macro def
2024-11-29 15:05:10 +00:00
John Colvin
62a4073748
Skip md recording thread loop if no recorders configured to run
2024-11-29 15:05:10 +00:00