petefisher78/spark
1
0 Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
14,371 Commits 163 Branches 302 Tags
development.dev_trading
Commit Graph
469 Commits
Author SHA1 Message Date
John Colvin 64b4eec999 build: Change publish_data_stream.py to publish the sln 
We were publishing individual projects as a workaround for the
dependency issue (bug) that caused some projects to incorrectly target
net8.0. The fact that publishing individual projects "just worked" was
probably dumb luck. Now that the underlying issue has been addressed, we
can resume publishing the sln as a whole.
 2025-07-23 16:11:50 -04:00
John Colvin 844c842357 fix: Add self-signed certificate to Dockerfile for ds webapp 2025-07-23 16:08:14 -04:00
John Colvin 1474c84848 Define webapp specific env vars in generic datastream app deploy script 
For now, this makes things easier, as I don't need to write a special script just for the webapp
 2025-07-23 16:06:25 -04:00
John Colvin 97f4268686 Add config profile and Dockerfile args to deploy script 2025-07-23 16:06:11 -04:00
John Colvin 678fb0ac4e Copy DataStream WebApp 'dist' to 'wwwroot' in deploy script 2025-07-23 16:06:00 -04:00
John Colvin 9e554c1950 Add scripts to deploy data stream apps 2025-07-23 16:03:08 -04:00
John Colvin dffc08c790 Publish Bts.DataStreamWebApp.Server along with PubSub & DataStream 2025-07-23 16:01:19 -04:00
John Colvin f43e7d4724 build: Add scripts to publish data stream apps 2025-07-23 15:33:31 -04:00
John Colvin c6e7cdcf35 Fix build scripts so they propagate the exit code back to the shell 
I noticed this was broken because launch.json configurations would still
start the debugger even when the preLaunchTask (build) failed!
 2025-07-23 15:30:32 -04:00
John Colvin 11bb3234da build: Use separate cmd to build DataStreamSuite/QueryAnalyzer.sln 
The DataStreamSuite.sln builds the new webapp now, which will
(eventually) replace DSQA. We'll keep it around for now, but with a
clean separation from the main build.
 2025-07-23 15:26:30 -04:00
John Colvin 7d6d63365e feat: Add DataStream WebApp 
Included in DataStreamSuite.sln, but not DataStreamQueryAnalyzer.sln
 2025-07-23 15:21:58 -04:00
John Colvin b214198dd6 cleanup: Fix benign typos in build scripts 
Change BUILD_SPARK_PY var name to BUILD_PY (these scripts build other
projects than 'spark').
 2025-07-23 15:11:19 -04:00
John Colvin 0b3fa813f1 tool: Add script to dump structured logs to console 2025-07-17 16:25:23 +00:00
John Colvin 83f1b5b567 dev qol: In envsource.fish, split PATH vars into list 
Assume they are semi-colon delimited.
 2025-06-24 10:48:42 -04:00
John Colvin e6466f8309 chore: Add CANCEL_ORDER op to binance.env 2025-06-16 11:08:56 -04:00
John Colvin 7dea9b3792 fix: Don't raise ex if var isn't defined in req path 2025-06-16 11:08:56 -04:00
John Colvin 4681f22e71 deploy: Move configurations to new stutter dir "app_sparkd" 2025-06-16 11:08:54 -04:00
John Colvin 5163ca4cae refactor: Organize libspark proj w/ stuttering include 
This new structure provides several benefits:

* Allows us to install multiple CMake projects in the same destination
  dir (without include path conflicts).
  - This makes shipping the trading algo sdk a trivial excercise. Simply
    copy the lib and include dirs from the install dest. That's it!
* Puts us in a position to break up the monolithic libspark into smaller
  modules, which are easier to manage.

Windows specific notes:

* Get rid of unnecessary script vs_filters.cmake
* Define WebsocketConnectionGateway directly in cs (instead of proto)
  - The proto would no longer be in the include path passed to protoc.
    Moving it to c# because there wasn't a compelling reason for it to
    be a proto in the first place.
* Set spark output prefix to "lib" on windows
  - So we get "libspark.dll" instead of "spark.dll", which conflicts
    with the csharp lib, "Spark.dll".
* Copy libspark.dll to net8.0 & net8.0-windows in a single cmake build
  target

fix build: Copy libspark to both dirs net8.0, net8.0-windows
 2025-06-16 11:08:53 -04:00
John Colvin 5ad7755b28 tool: Make open orders symbol param optional in binance.env 2025-05-20 20:08:34 +00:00
John Colvin df4ca124c3 cleanup: Remove redundant script get_binance_md.sh 
I should have removed this when I added binance_rest_client.sh
 2025-05-20 20:08:34 +00:00
John Colvin 2c8b9ee288 tool: Add envsource.fish to load .env files in fish 2025-05-20 20:08:34 +00:00
John Colvin f02f28e347 tool: Add a few vars to binance.env 2025-05-20 20:08:34 +00:00
John Colvin c8a89c1e8d cleanup: Rename get_binance_md.py -> binance_client.py 
This is a more appropriate name (it's not just md anymore).
 2025-05-20 20:08:34 +00:00
John Colvin 7ae9e07a30 tool: Use binance.env file in python client 
Like the bash impl (binance_rest_client.sh), it gets urls, params
(templates), and api credentials from env vars.
 2025-05-20 20:08:34 +00:00
John Colvin af9eb670c1 build: Update build scripts to target dotnet 8 2025-04-30 12:06:28 -04:00
John Colvin 61f04c4605 fix: Implement state machine for binance cxl/replace 2025-04-28 17:12:59 +00:00
John Colvin 043efab5a2 build: Upgrade c# to net8.0 2025-04-28 17:12:58 +00:00
John Colvin 54cb5a2ab2 tool: Add script to configure aws sso 2025-04-28 17:12:58 +00:00
John Colvin 10436f0f3b tool: Rename binance_orders_client.sh -> binance_rest_client.sh 
It supports md and order/trade requests
 2025-04-28 17:12:58 +00:00
John Colvin eeffb735ae deploy (fix): Override existing values when loading env files 2025-04-16 13:48:24 +00:00
John Colvin b602997f3a deploy: Build sparkd if any service starts with "sparkd" 
Previously, we only built sparkd for the "sparkd" service (i.e., exact match)
 2025-04-16 13:48:24 +00:00
arham 14e3eee0bc Add: config changes to make server controller work and set up hk zen server 2025-04-09 09:42:47 -04:00
John Colvin 716c4dd674 tool: Add script to dump sparkd logs to sqlite db 2025-03-19 14:41:23 +00:00
John Colvin 10b2d38de8 tool: Add cmd to tail sparkd log file using docker compose 2025-03-17 00:51:54 +00:00
John Colvin 3f58c2ce84 Add script to install aws cli 
The aws cli can be used to configure credentials in the shell in order
to retrieve secrets (e.g., production api keys for alphaworx, etc.).
 2025-03-10 05:24:49 +00:00
John Colvin b555850015 build: Package & deploy sparkd with docker compose 2025-03-10 03:05:59 +00:00
John Colvin aa602b3fd6 tool: Add cross margin reqs to binance.env 2025-03-05 18:04:04 +00:00
John Colvin b4b8cabdae tool: Add listen key reqs to binance.env 2025-03-05 18:04:04 +00:00
John Colvin cfe06869b3 tool: Support empty query params in binance_orders_client.sh 2025-03-05 18:04:04 +00:00
John Colvin 71f7e64ccb Move config profiles dir to server/sparkd 2025-03-05 16:00:43 +00:00
John Colvin 19efb77e07 tool: Add some usds futures requests to binance.env 2025-02-24 15:12:45 +00:00
John Colvin fb030742d3 Clean up binance_orders_client.sh a bit, add docs 2025-02-24 06:06:15 +00:00
John Colvin f0651a5341 tool: Add flag to roll logs without running sparkd 2025-02-23 15:36:10 +00:00
John Colvin 9d81354c3a Add binance_orders_client.sh for quick/easy troubleshooting 2025-02-23 15:36:10 +00:00
John Colvin 0f37be89a4 Fix typos in binance.env 2025-02-23 15:36:10 +00:00
John Colvin 4dcd5d63a1 tool: Add script to easily switch between spark.conf profiles 2025-02-23 06:10:36 +00:00
John Colvin 284aa53ad4 Add script to run sparkd and roll over log w/ timestamp suffix 
So each run gets its own log file
 2025-02-19 22:49:30 +00:00
John Colvin 582fc10dce Add get_binance_md.sh for quick/easy troubleshooting 2025-02-12 20:34:47 +00:00
John Colvin c8fc649b6b fix build: Pass config arg to cmake --build 
For Ninja Multi-Config builds (i.e., api server and data streams)
 2025-01-28 19:59:09 +00:00
John Colvin b1f4654b3c Fix benign typo in publish_spark.py 2025-01-21 17:28:50 -05:00