John Colvin
8cd2bb3d49
fix: Expand undefined vars to empty string
...
Bugs (fixed):
* Md shared memory file names have unexpanded variable: '${BTS_SHARED_MEMORY_PREFIX}'
2024-10-14 15:51:44 +00:00
John Colvin
5e62b42404
fix: Emplace MDConsumerHandle instead of copy assign
2024-10-14 15:51:44 +00:00
John Colvin
8665d2137f
Generate c++ protos w/ relative paths
...
We shouldn't be generating protos defined outside of the current CMakeLists.txt dir.
2024-10-14 15:51:44 +00:00
John Colvin
811dee2d04
fix build: Make venue conversion constexpr
2024-10-14 15:51:44 +00:00
John Colvin
373b377da4
build: Use new/robust init_library fn in lib_domain
2024-10-14 15:51:44 +00:00
John Colvin
11afb0ff40
refactor: Move config services to lib_system
...
The proto files are still in lib_spark, w/ the exception of
system_config.proto, since that is a dep of ConfigurationState.
2024-10-14 15:51:44 +00:00
John Colvin
01b0ebe01d
refactor: Move logging into lib_system
...
This is a fundamental part of our application suite, so system seems
like a sensible home.
Also moved a few logging deps (to lib_system):
* bts_chrono.h
* bts_no_copy.h
* defer.h
* dispatcher.h/cpp
* file_utils.h/cpp
* type_name.h
2024-10-14 15:20:47 +00:00
John Colvin
8bc692605f
build: Move http code into its own lib
2024-10-14 15:19:20 +00:00
John Colvin
80da994a14
refactor: Move thread_manager to lib_system
2024-10-13 20:42:19 +00:00
John Colvin
e5ba13eded
build (linux): Migrate catch2 dep to vcpkg (from externals)
2024-10-13 20:42:19 +00:00
John Colvin
bc8ca9afd8
build (linux): Migrate fmt dep to vcpkg (from externals)
...
Now both linux and windows use vcpkg's fmt
2024-10-13 20:41:37 +00:00
John Colvin
17d6a64df8
cleanup: Remove unnecessary includes
2024-10-13 19:38:42 +00:00
John Colvin
ca4e796560
refactor: Move threads.proto to lib_system
2024-10-13 19:38:38 +00:00
John Colvin
32691e8c9c
refactor: Move warn_ctrl.h into lib_system
...
This is another logging dep
2024-10-12 19:54:51 +00:00
John Colvin
0be0501716
build: Link boost_filesystem in lib_system
2024-10-12 19:54:51 +00:00
John Colvin
1e2c361231
refactor: Move os.h/cpp and deps to lib_system
...
This is a prerequisite for the next objective: move logging into its own lib.
As logging is a core dependency for so much of our system, this will enable
us to move more complex services (like md providers) into smaller libs.
2024-10-12 19:54:51 +00:00
John Colvin
f4b7f4fd88
cleanup: Remove unused code
2024-10-12 19:54:51 +00:00
John Colvin
05af82fefc
cleanup: Remove more unnecessary includes
2024-10-12 19:54:51 +00:00
John Colvin
7de36a877f
refactor: Move SecurityMarketDataStatistics to lib_domain
2024-10-12 19:54:51 +00:00
John Colvin
732ed02dea
cleanup: Remove unnecessary code
2024-10-12 19:54:51 +00:00
John Colvin
bdf4ea595d
cleanup: Remove empty header FTXSecurity.h
2024-10-12 19:54:51 +00:00
John Colvin
dc90f2b79a
cleanup: Remove temporary redirect headers
...
These were used to make code migration smoother (to the new lib_system and lib_domain)
* spark/algorithm/TryCatch.h -> system/algorithm/try_catch.h
* spark/core/BoolName.h -> system/bool_name.h
* spark/core/EnumMacros.h -> system/enum_macros.h
* spark/core/FMT.h -> system/FMT.h
* spark/core/FMT_IMPL.h -> system/FMT_IMPL.h
* spark/core/TimeSpan.h -> system/time_span.h
* spark/core/TimeStamp.h -> system/time_stamp.h
* spark/domain/Price.h -> domain/price.h
* spark/io/JsonReader.h -> system/json/json_reader.h
* spark/io/JsonDumper.h -> system/json/json_dumper.h
2024-10-12 19:54:49 +00:00
John Colvin
07b3947738
refactor: Move RFQ to lib_domain
2024-10-12 19:53:27 +00:00
John Colvin
cc8e0bd6a9
refactor: Move AggressorSide proto to lib_domain
...
Get rid of non-proto AggressorSide enum while we're at it (consolidate to 1 type)
2024-10-12 19:53:27 +00:00
John Colvin
5959538aca
cleanup: Remove more unused code
2024-10-12 19:53:27 +00:00
John Colvin
65f435598c
refactor: Move a few Order types to lib_domain
2024-10-12 19:53:27 +00:00
John Colvin
70d89e5bc1
refactor: Move TimeInForce to lib_domain
2024-10-12 19:53:27 +00:00
John Colvin
87722765db
cleanup: Remove unused code
2024-10-12 19:53:27 +00:00
John Colvin
b6961f558a
refactor: Move TradeRecord into lib_domain
2024-10-12 19:53:27 +00:00
John Colvin
351fca18e1
refactor: Move TradingStatus enum to lib_domain
2024-10-12 19:53:27 +00:00
John Colvin
13a5f78ab1
build: Update webpack-cli in admin webapp
2024-10-12 19:53:27 +00:00
John Colvin
8735187963
build: Configure admin webapp build entirely in CMakeLists
...
Get rid of build_admin_web_app.py
2024-10-12 19:53:27 +00:00
John Colvin
edda8ae20c
refactor: Move domain types into new lib_domain
...
Also rename files in snake_case (standard naming convention for protos)
https://protobuf.dev/programming-guides/style/
2024-10-12 19:53:26 +00:00
John Colvin
b48bfbae79
refactor: Move collections into lib_system
2024-10-12 19:30:05 +00:00
John Colvin
465b293e54
refactor: Move a handful of types/utils to lib_system
2024-10-12 19:30:04 +00:00
John Colvin
7b37c67568
build: Add preset to build with 6 jobs (-j 6)
...
Otherwise the devcontainer may hog too much cpu and cause the container to freeze
2024-10-12 19:30:04 +00:00
John Colvin
a57e1d5cf3
cleanup: Remove unused includes
...
Mostly collection macro headers
2024-10-12 19:30:04 +00:00
John Colvin
97b99f87d1
cleanup (build): Move protobuf service generation cmake into lib_spark
...
Because lib_spark owns all the services
2024-10-12 19:30:04 +00:00
John Colvin
d071021305
refactor: Rename protobuf out dir "include" -> "protobufs"
...
This is a more accurate and precise name. The dir contains c++ code generated
from .proto files - both sources (.cc) and headers (.pb.h).
2024-10-12 19:30:04 +00:00
John Colvin
f2553695ea
refactor: Move ValueWrapper into lib_system
...
So other projects can use it
2024-10-12 19:30:04 +00:00
John Colvin
a2fab4afaf
Include bts_assert.h in bts_fatal.h
...
We shouldn't have to include bts_assert.h when we're already including bts_fatal.h
2024-10-12 19:30:04 +00:00
John Colvin
32a8b82cd4
refactor: Split MarketDataGateway up into providers/sources
...
MarketDataGateway still exists, but is greatly simplified. It creates
several `IMarketDataProvider`s, each of which generates a list of
`IMarketDataSource`s. The market data sources provide market data to an
`IMarketDataListener`.
* EmumbaMarketDataProvider
* CCApiMarketDataProvider
* PyMarketDataProvider
* OnixsMarketDataProvider
* ReplayMarketDataProvider
As a side effect, individual py market data sources are now explicitly
limited to a single venue (it probably should have been this way all
along, since the shared memory writers do not expect updates to involve
multiple venues).
2024-10-12 19:30:03 +00:00
John Colvin
eea830e9f8
cleanup: Remove superfluous code
2024-10-12 18:38:37 +00:00
John Colvin
c5ca6ad712
improvement: Set SHARED_MEMORY_PREFIX to an environment variable
...
So we can effectively define it at runtime. We don't want to have to
produce different builds just to change the shared mem prefix.
2024-10-12 18:38:37 +00:00
John Colvin
fee7b7bc47
fix: Always prepend proc name to shared mem prefix
...
Our shared memory model isn't really designed to be shared across processes.
Maybe some day it will.
2024-10-12 18:38:37 +00:00
John Colvin
c06c768f76
cleanup: Remove redundant macro def
2024-10-12 18:38:37 +00:00
John Colvin
71710ae88c
Skip md recording thread loop if no recorders configured to run
2024-10-12 18:38:37 +00:00
John Colvin
4671c12b6f
Handle signal interrupts explicitly in sparkd
...
Otherwise the python interpretter, which is instantiated when we load
python md plugins, prevents the application from exiting.
2024-10-12 18:38:37 +00:00
John Colvin
a5489e8fc7
feat: Add support for python md plugins
2024-10-12 18:38:36 +00:00
John Colvin
84432dd67a
fix build: Ensure py scripts use unix line endings
...
I'm not sure why, but my sparkd build (linux) suddenly began failing to
generate cpp headers for protos. The error message indicated it was due
to an unexpected carriage return (\r) in plugin.py:
/usr/bin/env: ‘python\r’: No such file or directory
2024-10-12 18:37:16 +00:00