John Colvin
b18facfa87
fix build warnings: Make props nullable strings in SharedStreamConfig
2024-11-29 14:57:43 +00:00
John Colvin
397f6156dc
whitespace: Format PubSubServer.json (indentation issues)
2024-11-29 14:57:43 +00:00
John Colvin
98717e378f
Add a few tasks to run DataStream WebApp
2024-11-29 14:57:43 +00:00
John Colvin
d277495610
fix: Import websocket url from environment var
2024-11-29 14:57:43 +00:00
John Colvin
250f34e3de
Add scripts to deploy data stream apps
2024-11-29 14:57:43 +00:00
John Colvin
00c06429b1
Add SpaServer to Production environment
...
For Bts.DataStreamWebApp.Server
2024-11-29 14:57:43 +00:00
John Colvin
254e3d38af
Change DirectoryBrowser requestPath to "/browse"
...
So we can view a psuedo file explorer for the webapp by requesting the "/browse" path
(only activated in Development environment).
2024-11-29 14:57:43 +00:00
John Colvin
4156c6b733
Publish Bts.DataStreamWebApp.Server along with PubSub & DataStream
2024-11-29 14:57:43 +00:00
John Colvin
fc40ea412f
cleanup: Remove unused code in Bts.DataStreamWebApp.Client
2024-11-29 14:57:43 +00:00
John Colvin
e03b7d5991
Capture OperationCanceledException (instead of TaskCanceledException)
...
The former is the base class for the latter, so this will widen the umbrella to catch a few corner cases
that would otherwise been handled by the generic "Exception" catch block. One corner case I know
of is when an op is canceled via "CancellationToken.ThrowIfCancellationRequested". In that case,
an OperationCanceledException is thrown (not a TaskCanceledException).
https://stackoverflow.com/questions/34359129/operationcanceledexception-vs-taskcanceledexception-when-task-is-canceled
2024-11-29 14:57:43 +00:00
John Colvin
0e198e0ebf
Hardcode webSocketUrl to aws server in DataStreamWebApp client
2024-11-29 14:57:43 +00:00
John Colvin
27a9bf66bb
Assert that System publishers 'doWork' is always called on same thread
2024-11-29 14:57:43 +00:00
John Colvin
2a390c7c2e
fix: Make InternalPublisherQueue thread safe
2024-11-29 14:57:43 +00:00
John Colvin
ee0d444ae6
Improve error reporting in DataStreamWebSocketServer
2024-11-29 14:57:43 +00:00
John Colvin
b058cde0ca
data stream web app client check pt
2024-11-29 14:57:43 +00:00
John Colvin
39bb411bda
fix build: Fix Spark build after making config init async
2024-11-29 14:57:43 +00:00
John Colvin
7423721c72
refactor: Tweak SparkCoreServices to synchronize Configuration.init globally
2024-11-29 14:57:43 +00:00
John Colvin
ffbf7b5e8d
refactor: Change Configuration.initialize to be async
2024-11-29 14:57:43 +00:00
John Colvin
eb5aa9c3c7
vscode: Add 'isSparkApiEnabled' input to launch.json
2024-11-29 14:57:43 +00:00
John Colvin
b90730fd11
SparkApiService check pt
2024-11-29 14:57:43 +00:00
John Colvin
142d530999
datastreamwebapp server checkpt
2024-11-29 14:57:43 +00:00
John Colvin
a5670d2aaa
datastream webapp client check pt
2024-11-29 14:57:43 +00:00
John Colvin
3179e9add3
Remove unused PubSubConfig props
2024-11-29 14:57:43 +00:00
John Colvin
8dae6e37e6
Fix dsqa config json
2024-11-29 14:57:43 +00:00
John Colvin
eb0086d2c6
fix: Always call 'handle_internal_pubs' in PubSubMessageReactor main loop
2024-11-29 14:57:43 +00:00
John Colvin
0f680b1947
improvement: Accept CancellationToken, catch exceptions when running ds websocket server
2024-11-29 14:57:43 +00:00
John Colvin
e4745a587f
Fix mismatched types in PubSubServerTagStatsStream schema
2024-11-29 14:57:43 +00:00
John Colvin
adfc0b5235
Add DataStreamPublisher service modules designed for Dependency Injection
...
* Change DataStreamPublisher json fields to match cs class property names verbatim
* Rename Publishers -> PublisherNodes in DataStreamPublisherConfig
2024-11-29 14:57:43 +00:00
John Colvin
30cf7ac5f9
refactor: Decouple ViewPublisher from IPubTableBroker impl
2024-11-29 14:57:43 +00:00
John Colvin
31b065c854
Add PubSub service modules designed for Dependency Injection
...
* Get rid of JsonPropertyName attributes in PubSubConfig
- The Dependency Injection framework (based around dotnet ApplicationBuilder)
does not support this attribute, and maps property names verbatim to json fields.
* Change PubSubServer json fields to match cs class property names verbatim
2024-11-29 14:57:43 +00:00
John Colvin
04a0cf9144
refactor: Decouple RemoteQueryManager from IManagedSubscriber, IPubTableBroker impl
2024-11-29 14:57:43 +00:00
John Colvin
37d6ffa27a
refactor: Decouple ManagedSubscriber from ISubscriberCore impl
2024-11-29 14:57:43 +00:00
John Colvin
2760867093
refactor: Only support 1 tag type in IPubSubServerTagHandler
2024-11-29 14:57:43 +00:00
John Colvin
191de2ae46
refactor: Decouple PubTableBroker from IPublisherCore impl
...
Reference interface rather than the PublisherCore impl.
2024-11-29 14:57:43 +00:00
John Colvin
0b444d5f2f
improvement: Accept CancellationToken in JsonRpcRequestObservable
2024-11-29 14:57:43 +00:00
John Colvin
702eac44d3
fix: Dispose market data sub in various md streams
2024-11-29 14:57:43 +00:00
John Colvin
30b23d36fa
cleanup: Remove unused pubsub tag handler code
...
* Removed 'IPubSubServerTagHandler.register'
- All implementations of this function were empty
* Removed 'IPubSubServerTagHandler.supportedTagTypes'
- This property wasn't referenced anywhere
* Remove IWorker inheritance from IPubSubServerTagHandler
- No reason these interfaces have to be tied together
2024-11-29 14:57:43 +00:00
John Colvin
202a9f6206
refactor: Rename CloudStreamManager.cs -> RemoteQueryManager.cs
...
This matches the file name
2024-11-29 14:57:43 +00:00
John Colvin
0d1966e752
Change pub sub schema prefix 'bluto://' -> 'bts-cloud://'
...
In config json files (not actual code change)
2024-11-29 14:57:43 +00:00
John Colvin
a25905d55d
fix build: Fix prop names after refactoring PubSubRoute
...
* Change 'server_address' -> 'ServerAddress'
* Change 'tag_reg_exp' -> 'TagRegExp'
2024-11-29 14:57:43 +00:00
John Colvin
dddf14e356
build: Add scripts to publish data stream apps
2024-11-29 14:57:42 +00:00
John Colvin
962fd8712a
Fix typo in log msg
2024-11-29 14:57:13 +00:00
John Colvin
7685b1f628
Fix build scripts so they propagate the exit code back to the shell
...
I noticed this was broken because launch.json configurations would still start the debugger
even when the preLaunchTask (build) failed!
2024-11-29 14:57:13 +00:00
John Colvin
ef94ecf6a6
vscode: Add DataStreamPublisher debug cfg to skip build
2024-11-29 14:57:13 +00:00
John Colvin
26f9a76fc8
build: Use separate cmd to build DataStreamSuite/QueryAnalyzer.sln
...
The DataStreamSuite.sln builds the new webapp now, which will
(eventually) replace DSQA. We'll keep it around for now, but with a
clean separation from the main build.
2024-11-29 14:57:13 +00:00
John Colvin
806c204f08
feat: Add DataStream WebApp
...
Included in DataStreamSuite.sln, but not DataStreamQueryAnalyzer.sln
2024-11-29 14:57:13 +00:00
John Colvin
4aa3c67e87
Add spark service modules designed for Dependency Injection
2024-11-29 14:57:13 +00:00
John Colvin
614adac241
build: Copy libspark to all dotnet dirs in single cmake target
...
This is cleaner than the previous impl, which used separate build
targets to copy libspark to "net7.0", and "net7.0-windows" (dirs).
2024-11-29 14:57:13 +00:00
John Colvin
63ece377de
fix: Parse ServerAddress as normal string
...
The "JsonValueOrArrayConverter<T>" doesn't work the way I thought it
would. When it is associated with a property via the JsonConverter
attribute, dotnet json parsing code throws an exception if "T" isn't
assignable to the property type.
2024-11-29 14:57:13 +00:00
John Colvin
e49efc2bbf
fix build (api server): Change namespace to bts.websocket_core
2024-11-29 14:57:13 +00:00