Commit Graph
11998 Commits
Author SHA1 Message Date
John Colvin 88ebbceec5 refactor: Move a few Order types to lib_domain 2024-09-01 20:07:31 +00:00
John Colvin abde05a5b6 refactor: Move TimeInForce to lib_domain 2024-09-01 20:07:31 +00:00
John Colvin 96660bcd44 cleanup: Remove unused code 2024-09-01 20:07:31 +00:00
John Colvin a69b022e50 refactor: Move TradeRecord into lib_domain 2024-09-01 20:07:31 +00:00
John Colvin d658e31849 refactor: Move TradingStatus enum to lib_domain 2024-09-01 20:07:31 +00:00
John Colvin 58f8187cab build: Update webpack-cli in admin webapp 2024-09-01 20:06:01 +00:00
John Colvin 2198be05f8 build: Configure admin webapp build entirely in CMakeLists
Get rid of build_admin_web_app.py
2024-09-01 20:06:01 +00:00
John Colvin 55c64c744a refactor: Rename core_md -> domain 2024-09-01 20:06:01 +00:00
John Colvin 30166c4acc refactor: Move core_md protos into protobufs dir
Also rename files in snake_case (standard naming convention for protos)
https://protobuf.dev/programming-guides/style/
2024-08-27 15:46:09 +00:00
John Colvin fbc6622eb4 refactor: Move domain types into new lib core_md 2024-08-27 15:45:52 +00:00
John Colvin 299654e9d6 refactor: Move collections into lib_system 2024-08-27 15:40:05 +00:00
John Colvin 8ef2d42d3d refactor: Move a handful of types/utils to lib_system 2024-08-27 15:40:05 +00:00
John Colvin e7bc230c21 cleanup: Remove unused includes
Mostly collection macro headers
2024-08-27 15:40:05 +00:00
John Colvin 55ba3be74d cleanup (build): Move protobuf service generation cmake into lib_spark
Because lib_spark owns all the services
2024-08-27 15:40:05 +00:00
John Colvin b06c11d289 refactor: Rename protobuf out dir "include" -> "protobufs"
This is a more accurate and precise name. The dir contains c++ code generated
from .proto files - both sources (.cc) and headers (.pb.h).
2024-08-27 15:40:05 +00:00
John Colvin 18794bf3c8 refactor: Move ValueWrapper into lib_system
So other projects can use it
2024-08-27 15:40:05 +00:00
John Colvin 7c70828452 Include bts_assert.h in bts_fatal.h
We shouldn't have to include bts_assert.h when we're already including bts_fatal.h
2024-08-27 15:40:05 +00:00
John Colvin bb4805763b refactor: Split MarketDataGateway up into providers/sources
MarketDataGateway still exists, but is greatly simplified. It creates
several `IMarketDataProvider`s, each of which generates a list of
`IMarketDataSource`s. The market data sources provide market data to an
`IMarketDataListener`.

* EmumbaMarketDataProvider
* CCApiMarketDataProvider
* PyMarketDataProvider
* OnixsMarketDataProvider
* ReplayMarketDataProvider

As a side effect, individual py market data sources are now explicitly
limited to a single venue (it probably should have been this way all
along, since the shared memory writers do not expect updates to involve
multiple venues).
2024-08-27 15:39:57 +00:00
John Colvin 50e567edda fix build: Remove old install target
Leftover from before recent build refactoring.
2024-08-27 15:35:58 +00:00
John Colvin c66ac5b742 cleanup: Remove superfluous code 2024-08-27 15:35:58 +00:00
John Colvin 8356d3e394 fix: Always prepend proc name to shared mem prefix
Our shared memory model isn't really designed to be shared across processes.
Maybe some day it will.
2024-08-27 15:35:58 +00:00
John Colvin 48ae662fca cleanup: Remove redundant macro def 2024-08-27 15:35:58 +00:00
John Colvin 998d0e7133 Skip md recording thread loop if no recorders configured to run 2024-08-27 15:35:58 +00:00
John Colvin 45489850b7 refactor: Rename lib_py_market_data -> lib_python_md 2024-08-27 15:35:56 +00:00
John Colvin 5bb0c3654f Handle signal interrupts explicitly in sparkd
Otherwise the python interpretter, which is instantiated when we load
python md plugins, prevents the application from exiting.
2024-08-27 15:35:04 +00:00
John Colvin fa02d00bcc check pt: Python cpp md interop
refactor: Rename py-market-data -> py_market_data

Because '-' is an illegal character in py module names

build: Clean up py_market_data cmake proj

fix build: Ensure py scripts use unix line endings

I'm not sure why, but my sparkd build (linux) suddenly began failing to
generate cpp headers for protos. The error message indicated it was due
to an unexpected carriage return (\r) in plugin.py:

/usr/bin/env: ‘python\r’: No such file or directory

build: Add py_market_data_providers cmake proj

For md providers implemented in python. They're loaded as plugins in sparkd

Clean up MarketDataGateway python md plugins

cleanup: Merge provider py scripts into lib_py_market_data proj

doc: Add README and doxy docs for py md providers

cleanup: Remove old py_market_data_providers project

It has been merged into the py_market_data project.

Clean up py_market_data install, config.cmake

feat: Get python md plugins ready for prime time

* Add cmd to run python md provider c++ interop sanity check
2024-08-23 16:37:08 +00:00
John Colvin 079015674d Add lib_system proj for common utils
refactor: Move Delegate.h to lib_system

Rename delegate.h (lower case)

refactor: Move bts_array_size.h to lib_system

fix add lib system

fix system

fix move bts_array_size

fix move delegate
2024-08-23 16:36:16 +00:00
John Colvin 06a2c814d0 build: Clean up libspark CMakeLists 2024-08-23 16:36:16 +00:00
John Colvin ba90abf5ae cleanup: Trivial whitespace cleanup in sparkd CMakeLists 2024-08-23 16:36:16 +00:00
John Colvin 6106bc21ca cleanup: Use conventional UPPER_CASE var names in sparkd CMakeLists 2024-08-23 16:29:04 +00:00
John Colvin 9d56826797 build: Set up necessary paths, symlinks for sparkd in sparkd cmake proj
Rather than performing this step in the root CMakeLists, as we previously did
in the "server_layout" target. This effectively replaces the "server_layout" target.
2024-08-23 16:29:04 +00:00
John Colvin 92159c01ba build: Clean up data_files cmake proj (support --target clean) 2024-08-23 16:22:42 +00:00
John Colvin 8d260a979c fix build: Generate proto hdrs in "include" dir (child of proj's bin dir)
Reorganizing the sparkd proj with stuttering dirs broke the build because
the generated protos were being dumped into a dir with the same name
as the "sparkd" executable.
2024-08-23 16:22:42 +00:00
John Colvin 89305eb7cf fix build: Update sparkd & risk webapp after moving libspark 2024-08-23 16:22:42 +00:00
John Colvin bb1e113893 refactor: Parse input args in Protobuf_Generate_cpp
So we can be more precise when generating protobufs. For example, now we
can specify different include dirs when generating code for different
group of proto messages - an obvious improvement over the previous
system, which relied on a hardcoded superset of include dirs that would
support every proto message in our code base.
2024-08-23 16:22:42 +00:00
John Colvin 28f27deb2e refactor: Orgnaize libspark proj w/ stuttering include 2024-08-23 16:22:41 +00:00
John Colvin 9a1cc9664c build: Add install targets for libspark 2024-08-23 14:40:50 +00:00
John Colvin 8cde5bcd41 fix build: Add ShmSegmentName.cpp to windows client sources 2024-08-13 17:39:33 +00:00
John Colvin 43d0022878 Make a few timestamp fns const
They should have been const in the first place
2024-08-13 17:39:32 +00:00
John Colvin 65133e8a5e Add config profiles to libspark (check pt)
This is part of a larger effort to unify the libspark build, and eliminate
compile time differences between the builds used by our various services
2024-08-13 17:39:32 +00:00
John Colvin 781bc52ea1 Add api server to docker compose 2024-08-13 17:39:32 +00:00
John Colvin c5eba43ace Change api server ports so they don't conflict w/ ds webapp 2024-08-13 17:39:32 +00:00
John Colvin ae2c116840 build: Resolve app data dir and shared mem prefix at runtime
We really can't define them at compile time anymore as we build multiple
exes that depend on libspark in the same dir (e.g., spark api server,
pubsub, ds-publisher, webapp, etc.). That means one libspark.so (or dll)
must serve all exes. We should compile a consistent libspark to mitigate
the risk of running an exe with the wrong version (of libspark). For
example, running pubsub with a libspark configured for spark api server,
leftover from an earlier build.
2024-08-13 17:39:32 +00:00
John Colvin 65aeac3c73 Don't log "initializing spark config" if it has already been initialized 2024-07-31 08:32:04 -04:00
John Colvin e775bc19b8 Use dependency injection in spark api server 2024-07-31 00:02:11 -04:00
John Colvin a89c4a5e1e Add SparkLoggerAdapter for Msft ILogger 2024-07-31 00:00:29 -04:00
John Colvin d07eff613f Display exception stack trace w/ 1 call per line in ds webapp 2024-07-30 18:26:58 +00:00
John Colvin fc86a505ee Remove unused ErrorView from ds webapp 2024-07-30 18:25:16 +00:00
John Colvin 06eaec5165 Propagate ViewStream errors to webapp frontend 2024-07-30 18:24:24 +00:00
John Colvin 8e181a4060 Add ErrorChanged event to propagate DataStream exceptions 2024-07-30 17:22:01 +00:00