Commit Graph
13659 Commits
Author SHA1 Message Date
John Colvin b8799622d5 build: Move http code into its own lib 2024-10-17 05:37:16 +00:00
John Colvin 8b80c9821f refactor: Move thread_manager to lib_system 2024-10-17 05:34:30 +00:00
John Colvin 23d2c2d6c2 build (linux): Migrate catch2 dep to vcpkg (from externals) 2024-10-17 05:34:30 +00:00
John Colvin 60a34785a0 build (linux): Migrate fmt dep to vcpkg (from externals)
Now both linux and windows use vcpkg's fmt
2024-10-17 05:34:30 +00:00
John Colvin b8c4f772cc cleanup: Remove unnecessary includes 2024-10-17 05:33:12 +00:00
John Colvin d343f35fff refactor: Move threads.proto to lib_system 2024-10-17 05:33:12 +00:00
John Colvin ef7892e14e refactor: Move warn_ctrl.h into lib_system
This is another logging dep
2024-10-17 05:33:11 +00:00
John Colvin 08e8255b5a build: Link boost_filesystem in lib_system 2024-10-17 05:33:11 +00:00
John Colvin 4d1e0008d5 refactor: Move os.h/cpp and deps to lib_system
This is a prerequisite for the next objective: move logging into its own lib.
As logging is a core dependency for so much of our system, this will enable
us to move more complex services (like md providers) into smaller libs.
2024-10-17 05:33:11 +00:00
John Colvin cd2e7a5795 cleanup: Remove unused code 2024-10-17 05:33:11 +00:00
John Colvin e4a099cf6d cleanup: Remove more unnecessary includes 2024-10-17 05:33:11 +00:00
John Colvin d2bbd43ecb refactor: Move SecurityMarketDataStatistics to lib_domain 2024-10-17 05:33:11 +00:00
John Colvin 86eb53cc29 cleanup: Remove unnecessary code 2024-10-17 05:33:11 +00:00
John Colvin 95fda4f268 cleanup: Remove empty header FTXSecurity.h 2024-10-17 05:33:11 +00:00
John Colvin f7fba0b638 cleanup: Remove temporary redirect headers
These were used to make code migration smoother (to the new lib_system and lib_domain)

* spark/algorithm/TryCatch.h -> system/algorithm/try_catch.h
* spark/core/BoolName.h -> system/bool_name.h
* spark/core/EnumMacros.h -> system/enum_macros.h
* spark/core/FMT.h -> system/FMT.h
* spark/core/FMT_IMPL.h -> system/FMT_IMPL.h
* spark/core/TimeSpan.h -> system/time_span.h
* spark/core/TimeStamp.h -> system/time_stamp.h
* spark/domain/Price.h -> domain/price.h
* spark/io/JsonReader.h -> system/json/json_reader.h
* spark/io/JsonDumper.h -> system/json/json_dumper.h
2024-10-17 05:33:11 +00:00
John Colvin 08598d2b78 refactor: Move RFQ to lib_domain 2024-10-17 05:33:11 +00:00
John Colvin 5ecef5f34d refactor: Move AggressorSide proto to lib_domain
Get rid of non-proto AggressorSide enum while we're at it (consolidate to 1 type)
2024-10-17 05:33:11 +00:00
John Colvin ec9fabb26e cleanup: Remove more unused code 2024-10-17 05:33:11 +00:00
John Colvin c11f0157c5 refactor: Move a few Order types to lib_domain 2024-10-17 05:33:11 +00:00
John Colvin f1ace62773 refactor: Move TimeInForce to lib_domain 2024-10-17 05:33:11 +00:00
John Colvin 5b40ea03a6 cleanup: Remove unused code 2024-10-17 05:33:11 +00:00
John Colvin bf8dccf5eb refactor: Move TradeRecord into lib_domain 2024-10-17 05:33:11 +00:00
John Colvin bdcb71ec7f refactor: Move TradingStatus enum to lib_domain 2024-10-17 05:33:11 +00:00
John Colvin a6b387afec build: Update webpack-cli in admin webapp 2024-10-17 05:33:11 +00:00
John Colvin 603f810465 build: Configure admin webapp build entirely in CMakeLists
Get rid of build_admin_web_app.py
2024-10-17 05:33:11 +00:00
John Colvin 304c6fd4d1 refactor: Move domain types into new lib_domain
Also rename files in snake_case (standard naming convention for protos)
https://protobuf.dev/programming-guides/style/
2024-10-17 05:33:11 +00:00
John Colvin 30ee2cab3d refactor: Move collections into lib_system 2024-10-17 05:29:46 +00:00
John Colvin aa95fb3a35 refactor: Move a handful of types/utils to lib_system 2024-10-17 05:29:46 +00:00
John Colvin af1bc96e01 build: Add preset to build with 6 jobs (-j 6)
Otherwise the devcontainer may hog too much cpu and cause the container to freeze
2024-10-17 05:29:46 +00:00
John Colvin d41fa8a5fb cleanup: Remove unused includes
Mostly collection macro headers
2024-10-17 05:29:46 +00:00
John Colvin 1da52e9a5a cleanup (build): Move protobuf service generation cmake into lib_spark
Because lib_spark owns all the services
2024-10-17 05:29:46 +00:00
John Colvin 53739e3919 refactor: Rename protobuf out dir "include" -> "protobufs"
This is a more accurate and precise name. The dir contains c++ code generated
from .proto files - both sources (.cc) and headers (.pb.h).
2024-10-17 05:29:45 +00:00
John Colvin 18ea0ec425 refactor: Move ValueWrapper into lib_system
So other projects can use it
2024-10-17 05:29:45 +00:00
John Colvin 0b3a3d8833 Include bts_assert.h in bts_fatal.h
We shouldn't have to include bts_assert.h when we're already including bts_fatal.h
2024-10-17 05:29:45 +00:00
John Colvin b8d35cc0f9 refactor: Split MarketDataGateway up into providers/sources
MarketDataGateway still exists, but is greatly simplified. It creates
several `IMarketDataProvider`s, each of which generates a list of
`IMarketDataSource`s. The market data sources provide market data to an
`IMarketDataListener`.

* EmumbaMarketDataProvider
* CCApiMarketDataProvider
* PyMarketDataProvider
* OnixsMarketDataProvider
* ReplayMarketDataProvider

As a side effect, individual py market data sources are now explicitly
limited to a single venue (it probably should have been this way all
along, since the shared memory writers do not expect updates to involve
multiple venues).
2024-10-17 05:29:45 +00:00
John Colvin eb81da9863 cleanup: Remove superfluous code 2024-10-17 05:29:45 +00:00
John Colvin 9ea79c0bc9 improvement: Set SHARED_MEMORY_PREFIX to an environment variable
So we can effectively define it at runtime. We don't want to have to
produce different builds just to change the shared mem prefix.
2024-10-17 05:29:45 +00:00
John Colvin 621cdb90a4 fix: Always prepend proc name to shared mem prefix
Our shared memory model isn't really designed to be shared across processes.
Maybe some day it will.
2024-10-17 05:29:45 +00:00
John Colvin 3ded2653ad cleanup: Remove redundant macro def 2024-10-17 05:29:45 +00:00
John Colvin e92a91b450 Skip md recording thread loop if no recorders configured to run 2024-10-17 05:29:45 +00:00
John Colvin 9d66f268ec Handle signal interrupts explicitly in sparkd
Otherwise the python interpretter, which is instantiated when we load
python md plugins, prevents the application from exiting.
2024-10-17 05:29:45 +00:00
John Colvin a81f176de6 feat: Add support for python md plugins 2024-10-17 05:29:45 +00:00
John Colvin 3ff3f62be3 fix build: Ensure py scripts use unix line endings
I'm not sure why, but my sparkd build (linux) suddenly began failing to
generate cpp headers for protos. The error message indicated it was due
to an unexpected carriage return (\r) in plugin.py:

/usr/bin/env: ‘python\r’: No such file or directory
2024-10-17 05:24:19 +00:00
John Colvin 09b28704e6 refactor: Add lib_system proj for common utils
Migrates the following:
* Delegate.h
* bts_array_size.h
* string_utils.h

Note: File names in the new lib are snake_case (this seems to be the
standard naming convention for c++).
2024-10-17 05:24:19 +00:00
John Colvin 586fdefc45 cleanup: Trivial whitespace cleanup in sparkd CMakeLists 2024-10-16 18:35:26 +00:00
John Colvin 99f13b5ba5 build: Add cmake fns to symlink and install local libs
The code needed to do this (inline) is ugly and verbose
2024-10-16 18:35:26 +00:00
John Colvin 5c9624380e cleanup: Use conventional UPPER_CASE var names in sparkd CMakeLists 2024-10-16 18:35:26 +00:00
John Colvin ca6429e483 cleanup: Trivial whitespace cleanup in Protobuf.cmake 2024-10-16 18:35:26 +00:00
John Colvin 9f1e4d8b3e build: Clean up data_files cmake proj (support --target clean) 2024-10-16 18:35:16 +00:00
John Colvin 7e79430aeb refactor: Organize libspark proj w/ stuttering include
This new structure provides several benefits:

* Allows us to install multiple CMake projects in the same destination
  dir (without include path conflicts).
  - This makes shipping the trading algo sdk a trivial excercise. Simply
    copy the lib and include dirs from the install dest. That's it!
* Puts us in a position to break up the monolithic libspark into smaller
  modules, which are easier to manage.
2024-10-16 18:35:15 +00:00