Commit Graph
13639 Commits
Author SHA1 Message Date
John Colvin 8cd2bb3d49 fix: Expand undefined vars to empty string
Bugs (fixed):
  * Md shared memory file names have unexpanded variable: '${BTS_SHARED_MEMORY_PREFIX}'
2024-10-14 15:51:44 +00:00
John Colvin 5e62b42404 fix: Emplace MDConsumerHandle instead of copy assign 2024-10-14 15:51:44 +00:00
John Colvin 8665d2137f Generate c++ protos w/ relative paths
We shouldn't be generating protos defined outside of the current CMakeLists.txt dir.
2024-10-14 15:51:44 +00:00
John Colvin 811dee2d04 fix build: Make venue conversion constexpr 2024-10-14 15:51:44 +00:00
John Colvin 373b377da4 build: Use new/robust init_library fn in lib_domain 2024-10-14 15:51:44 +00:00
John Colvin 11afb0ff40 refactor: Move config services to lib_system
The proto files are still in lib_spark, w/ the exception of
system_config.proto, since that is a dep of ConfigurationState.
2024-10-14 15:51:44 +00:00
John Colvin 01b0ebe01d refactor: Move logging into lib_system
This is a fundamental part of our application suite, so system seems
like a sensible home.

Also moved a few logging deps (to lib_system):
* bts_chrono.h
* bts_no_copy.h
* defer.h
* dispatcher.h/cpp
* file_utils.h/cpp
* type_name.h
2024-10-14 15:20:47 +00:00
John Colvin 8bc692605f build: Move http code into its own lib 2024-10-14 15:19:20 +00:00
John Colvin 80da994a14 refactor: Move thread_manager to lib_system 2024-10-13 20:42:19 +00:00
John Colvin e5ba13eded build (linux): Migrate catch2 dep to vcpkg (from externals) 2024-10-13 20:42:19 +00:00
John Colvin bc8ca9afd8 build (linux): Migrate fmt dep to vcpkg (from externals)
Now both linux and windows use vcpkg's fmt
2024-10-13 20:41:37 +00:00
John Colvin 17d6a64df8 cleanup: Remove unnecessary includes 2024-10-13 19:38:42 +00:00
John Colvin ca4e796560 refactor: Move threads.proto to lib_system 2024-10-13 19:38:38 +00:00
John Colvin 32691e8c9c refactor: Move warn_ctrl.h into lib_system
This is another logging dep
2024-10-12 19:54:51 +00:00
John Colvin 0be0501716 build: Link boost_filesystem in lib_system 2024-10-12 19:54:51 +00:00
John Colvin 1e2c361231 refactor: Move os.h/cpp and deps to lib_system
This is a prerequisite for the next objective: move logging into its own lib.
As logging is a core dependency for so much of our system, this will enable
us to move more complex services (like md providers) into smaller libs.
2024-10-12 19:54:51 +00:00
John Colvin f4b7f4fd88 cleanup: Remove unused code 2024-10-12 19:54:51 +00:00
John Colvin 05af82fefc cleanup: Remove more unnecessary includes 2024-10-12 19:54:51 +00:00
John Colvin 7de36a877f refactor: Move SecurityMarketDataStatistics to lib_domain 2024-10-12 19:54:51 +00:00
John Colvin 732ed02dea cleanup: Remove unnecessary code 2024-10-12 19:54:51 +00:00
John Colvin bdf4ea595d cleanup: Remove empty header FTXSecurity.h 2024-10-12 19:54:51 +00:00
John Colvin dc90f2b79a cleanup: Remove temporary redirect headers
These were used to make code migration smoother (to the new lib_system and lib_domain)

* spark/algorithm/TryCatch.h -> system/algorithm/try_catch.h
* spark/core/BoolName.h -> system/bool_name.h
* spark/core/EnumMacros.h -> system/enum_macros.h
* spark/core/FMT.h -> system/FMT.h
* spark/core/FMT_IMPL.h -> system/FMT_IMPL.h
* spark/core/TimeSpan.h -> system/time_span.h
* spark/core/TimeStamp.h -> system/time_stamp.h
* spark/domain/Price.h -> domain/price.h
* spark/io/JsonReader.h -> system/json/json_reader.h
* spark/io/JsonDumper.h -> system/json/json_dumper.h
2024-10-12 19:54:49 +00:00
John Colvin 07b3947738 refactor: Move RFQ to lib_domain 2024-10-12 19:53:27 +00:00
John Colvin cc8e0bd6a9 refactor: Move AggressorSide proto to lib_domain
Get rid of non-proto AggressorSide enum while we're at it (consolidate to 1 type)
2024-10-12 19:53:27 +00:00
John Colvin 5959538aca cleanup: Remove more unused code 2024-10-12 19:53:27 +00:00
John Colvin 65f435598c refactor: Move a few Order types to lib_domain 2024-10-12 19:53:27 +00:00
John Colvin 70d89e5bc1 refactor: Move TimeInForce to lib_domain 2024-10-12 19:53:27 +00:00
John Colvin 87722765db cleanup: Remove unused code 2024-10-12 19:53:27 +00:00
John Colvin b6961f558a refactor: Move TradeRecord into lib_domain 2024-10-12 19:53:27 +00:00
John Colvin 351fca18e1 refactor: Move TradingStatus enum to lib_domain 2024-10-12 19:53:27 +00:00
John Colvin 13a5f78ab1 build: Update webpack-cli in admin webapp 2024-10-12 19:53:27 +00:00
John Colvin 8735187963 build: Configure admin webapp build entirely in CMakeLists
Get rid of build_admin_web_app.py
2024-10-12 19:53:27 +00:00
John Colvin edda8ae20c refactor: Move domain types into new lib_domain
Also rename files in snake_case (standard naming convention for protos)
https://protobuf.dev/programming-guides/style/
2024-10-12 19:53:26 +00:00
John Colvin b48bfbae79 refactor: Move collections into lib_system 2024-10-12 19:30:05 +00:00
John Colvin 465b293e54 refactor: Move a handful of types/utils to lib_system 2024-10-12 19:30:04 +00:00
John Colvin 7b37c67568 build: Add preset to build with 6 jobs (-j 6)
Otherwise the devcontainer may hog too much cpu and cause the container to freeze
2024-10-12 19:30:04 +00:00
John Colvin a57e1d5cf3 cleanup: Remove unused includes
Mostly collection macro headers
2024-10-12 19:30:04 +00:00
John Colvin 97b99f87d1 cleanup (build): Move protobuf service generation cmake into lib_spark
Because lib_spark owns all the services
2024-10-12 19:30:04 +00:00
John Colvin d071021305 refactor: Rename protobuf out dir "include" -> "protobufs"
This is a more accurate and precise name. The dir contains c++ code generated
from .proto files - both sources (.cc) and headers (.pb.h).
2024-10-12 19:30:04 +00:00
John Colvin f2553695ea refactor: Move ValueWrapper into lib_system
So other projects can use it
2024-10-12 19:30:04 +00:00
John Colvin a2fab4afaf Include bts_assert.h in bts_fatal.h
We shouldn't have to include bts_assert.h when we're already including bts_fatal.h
2024-10-12 19:30:04 +00:00
John Colvin 32a8b82cd4 refactor: Split MarketDataGateway up into providers/sources
MarketDataGateway still exists, but is greatly simplified. It creates
several `IMarketDataProvider`s, each of which generates a list of
`IMarketDataSource`s. The market data sources provide market data to an
`IMarketDataListener`.

* EmumbaMarketDataProvider
* CCApiMarketDataProvider
* PyMarketDataProvider
* OnixsMarketDataProvider
* ReplayMarketDataProvider

As a side effect, individual py market data sources are now explicitly
limited to a single venue (it probably should have been this way all
along, since the shared memory writers do not expect updates to involve
multiple venues).
2024-10-12 19:30:03 +00:00
John Colvin eea830e9f8 cleanup: Remove superfluous code 2024-10-12 18:38:37 +00:00
John Colvin c5ca6ad712 improvement: Set SHARED_MEMORY_PREFIX to an environment variable
So we can effectively define it at runtime. We don't want to have to
produce different builds just to change the shared mem prefix.
2024-10-12 18:38:37 +00:00
John Colvin fee7b7bc47 fix: Always prepend proc name to shared mem prefix
Our shared memory model isn't really designed to be shared across processes.
Maybe some day it will.
2024-10-12 18:38:37 +00:00
John Colvin c06c768f76 cleanup: Remove redundant macro def 2024-10-12 18:38:37 +00:00
John Colvin 71710ae88c Skip md recording thread loop if no recorders configured to run 2024-10-12 18:38:37 +00:00
John Colvin 4671c12b6f Handle signal interrupts explicitly in sparkd
Otherwise the python interpretter, which is instantiated when we load
python md plugins, prevents the application from exiting.
2024-10-12 18:38:37 +00:00
John Colvin a5489e8fc7 feat: Add support for python md plugins 2024-10-12 18:38:36 +00:00
John Colvin 84432dd67a fix build: Ensure py scripts use unix line endings
I'm not sure why, but my sparkd build (linux) suddenly began failing to
generate cpp headers for protos. The error message indicated it was due
to an unexpected carriage return (\r) in plugin.py:

/usr/bin/env: ‘python\r’: No such file or directory
2024-10-12 18:37:16 +00:00