John Colvin
06c494291c
dev qol: Add pyrightconfig.json for type hints in py/c++ bridge
2025-06-16 11:08:57 -04:00
John Colvin
fe74aed048
Tweak py to get rid of false positive type hint warns
2025-06-16 11:08:57 -04:00
John Colvin
b94cdb561e
feat: Support python execution plugins
2025-06-16 11:08:57 -04:00
John Colvin
06bd8791c0
refactor: Move py security (and related types) to python_core lib
...
So the execution gw plugins can use it (as well as the md plugins).
2025-06-16 11:08:57 -04:00
John Colvin
b5850cdb02
fix: Add missing switch cases for bybit & gateio
2025-06-16 11:08:57 -04:00
John Colvin
545d76142f
fix: Initialize bybit secs as perp futs (not spots)
2025-06-16 11:08:57 -04:00
John Colvin
edc2cea60e
dev qol: Add wait/notify functionality to ConcurrentQueue
2025-06-16 11:08:56 -04:00
John Colvin
e6466f8309
chore: Add CANCEL_ORDER op to binance.env
2025-06-16 11:08:56 -04:00
John Colvin
501be8d6a5
dev qol: Add ConcurrentValueStore, with notify/wait functionality
...
Uses std::condition_variable
2025-06-16 11:08:56 -04:00
John Colvin
7dea9b3792
fix: Don't raise ex if var isn't defined in req path
2025-06-16 11:08:56 -04:00
John Colvin
a3f49b1ce8
dev qol: Add gen-purpose validation fns for execution gws
2025-06-16 11:08:56 -04:00
John Colvin
765237d701
build: Use new gen-purpose python cmake fns in py md proj
...
Significantly simplifies CMakeLists.txt
2025-06-16 11:08:56 -04:00
John Colvin
97c52410a2
build: Add gen-purpose InitPythonModule, InitPythonPlugin cmake scripts
2025-06-16 11:08:56 -04:00
John Colvin
8b43d93e26
dev qol: Add fn to make Stopwatch and start it at once
2025-06-16 11:08:56 -04:00
John Colvin
14baa7d62e
chore: Use same log format as sparkd in py md plugins
2025-06-16 11:08:56 -04:00
John Colvin
a054f4cc63
improvement: Set PyBook data in single call to reduce interop overhead
2025-06-16 11:08:56 -04:00
John Colvin
5311128607
Reduce log noise in py md providers
2025-06-16 11:08:56 -04:00
John Colvin
075acdc8eb
doc: Improve py md readme
...
* Put examples in a table
* Show command to create symlinks for intellisense
2025-06-16 11:08:56 -04:00
John Colvin
e1fdf6306b
refactor: Redesign py md so it doesn't lock the global interpreter
...
We can only embed one interpreter in the sparkd process, so all py
plugins need to share it.
* Move core py interop code to new lib_python_core. We're about to add a
new lib for py execution, so it needs to be accesible from both
execution and md libs
* Fix typo for type hint in py_md_utils.py
* Run py md providers on background thread
* Rename MdSink -> MdBridge
2025-06-16 11:08:56 -04:00
John Colvin
3b9fb2759b
build: Add lib_spark subdir first (all others depend on it)
2025-06-16 11:08:56 -04:00
John Colvin
3f89d3b7f7
dev qol: Add to_chrono fns to TimeSpan
2025-06-16 11:08:56 -04:00
John Colvin
a6dd0d842d
dev qol: Add -> operators to ValueWrapper for convenience
...
So we can type "foo->" instead of "foo.value()" (much shorter!)
2025-06-16 11:08:56 -04:00
John Colvin
d050d2d19a
build: Link against system installed ssl to support py interop
...
Unless we want to build python packages ourselves, the underlying clibs
they use link to the system installed ssl. Notably, the requests module.
2025-06-16 11:08:56 -04:00
John Colvin
942d00a8b1
chore: Add pybind11, pybind11-stubgen to py venv
2025-06-16 11:08:56 -04:00
John Colvin
31cb25ac2e
improvement: Generate py stubs for md providers
...
Provides intellisense for the python_md_module
2025-06-16 11:08:56 -04:00
John Colvin
cbb43a22de
cleanup: Get rid of unecessary namespace prefixes
2025-06-16 11:08:55 -04:00
John Colvin
9e7b4849f0
cleanup: Get rid of "PyList" classes, bind to stl vector instead
...
I wasn't aware this was possible until recently.
2025-06-16 11:08:55 -04:00
John Colvin
6e72890153
refactor: Move SimpleOrderKeyMap from binance_execution to lib_spark
...
It provides basic functionality that will be useful in other execution gateways.
2025-06-16 11:08:55 -04:00
John Colvin
c238fce057
chore: Add smart parse and pretty name fns for proto enums
...
Mainly to ease the pain of representing enums as strings in python md
and execution plugins
2025-06-16 11:08:55 -04:00
John Colvin
b8f5db4ee2
refactor: Move ErrorList from binance_execution to lib_spark
...
It provides basic functionality that will be useful elsewhere
2025-06-16 11:08:55 -04:00
John Colvin
87c8b9862a
refactor: Use SmallString std::array in AccountName
2025-06-16 11:08:55 -04:00
John Colvin
fbc2d8633d
refactor: Use SmallString instead of std::array in ExchangeOrderID
2025-06-16 11:08:55 -04:00
John Colvin
d12d798fa5
Add our own "SmallString" class for fixed cap strings
...
This will replace the std::array<char, N> we use in ExecutionReport, etc.
among other things
2025-06-16 11:08:55 -04:00
John Colvin
e75be2da2f
refactor: Move ExecutionReportStore to lib_spark
...
From lib_binance_execution
2025-06-16 11:08:55 -04:00
Adeel Khan
3ae3a7094e
CLEANUP: BYBIT Symbols.conf.
2025-06-16 11:08:55 -04:00
Adeel Khan
bafa2f71ba
ADD: BYBIT MD Working, NaN's also Added.
2025-06-16 11:08:55 -04:00
Adeel Khan
63bd29a49e
ADD: BYBIT Securities showing up on frontend. Default Contract Spec
2025-06-16 11:08:55 -04:00
Adeel Khan
5fdc9ca48b
ADD: GATEIO md_provider with dynamic contract specs using Batch REST call
2025-06-16 11:08:55 -04:00
Adeel Khan
a19e7bc7b4
ADD: GATEIO md_provider with dynamic contract specs 1 REST call per Contract
2025-06-16 11:08:55 -04:00
Adeel Khan
04b0a89644
ADD: GATEIO md_provider with default contract specs
2025-06-16 11:08:55 -04:00
John Colvin
363a43cb8b
Add gateio_dev config profile for Adeel
2025-06-16 11:08:55 -04:00
John Colvin
c9f9c5f0f6
cleanup: Remove unused spark.conf file
...
Originally, this spark.conf was hardcoded into compose.yaml, and copied
into the sparkd container on each deploy. It hasn't been used since
config profiles were introduced.
2025-06-16 11:08:54 -04:00
John Colvin
ab84a05644
Add py_dummy_md config profile to test py md plugin
2025-06-16 11:08:54 -04:00
John Colvin
4681f22e71
deploy: Move configurations to new stutter dir "app_sparkd"
2025-06-16 11:08:54 -04:00
John Colvin
a25e055e35
Add protos for gateio
2025-06-16 11:08:54 -04:00
John Colvin
2386612b51
Add protos for bybit
2025-06-16 11:08:54 -04:00
John Colvin
3606dac145
build: Move onix fix adapter to its own lib
...
We should keep order execution dependencies out of lib_spark.
2025-06-16 11:08:54 -04:00
John Colvin
bf936c9d13
fix build: Move OnixsUtils to from lib_spark to app_sparkd
...
They're only needed MDP3Main.cpp and ICEMain.cpp. We're one step closer
to removing lib_spark's dependency on onixs.
2025-06-16 11:08:54 -04:00
John Colvin
1aeeb7170e
cleanup: Remove unnecessary onixs include from TrafixOrderStateHandler.h
2025-06-16 11:08:54 -04:00
John Colvin
78ad8a3aed
feat: Support python md plugins
2025-06-16 11:08:54 -04:00