Commit Graph
13567 Commits
Author SHA1 Message Date
John Colvin b18facfa87 fix build warnings: Make props nullable strings in SharedStreamConfig 2024-11-29 14:57:43 +00:00
John Colvin 397f6156dc whitespace: Format PubSubServer.json (indentation issues) 2024-11-29 14:57:43 +00:00
John Colvin 98717e378f Add a few tasks to run DataStream WebApp 2024-11-29 14:57:43 +00:00
John Colvin d277495610 fix: Import websocket url from environment var 2024-11-29 14:57:43 +00:00
John Colvin 250f34e3de Add scripts to deploy data stream apps 2024-11-29 14:57:43 +00:00
John Colvin 00c06429b1 Add SpaServer to Production environment
For Bts.DataStreamWebApp.Server
2024-11-29 14:57:43 +00:00
John Colvin 254e3d38af Change DirectoryBrowser requestPath to "/browse"
So we can view a psuedo file explorer for the webapp by requesting the "/browse" path
(only activated in Development environment).
2024-11-29 14:57:43 +00:00
John Colvin 4156c6b733 Publish Bts.DataStreamWebApp.Server along with PubSub & DataStream 2024-11-29 14:57:43 +00:00
John Colvin fc40ea412f cleanup: Remove unused code in Bts.DataStreamWebApp.Client 2024-11-29 14:57:43 +00:00
John Colvin e03b7d5991 Capture OperationCanceledException (instead of TaskCanceledException)
The former is the base class for the latter, so this will widen the umbrella to catch a few corner cases
that would otherwise been handled by the generic "Exception" catch block. One corner case I know
of is when an op is canceled via "CancellationToken.ThrowIfCancellationRequested". In that case,
an OperationCanceledException is thrown (not a TaskCanceledException).

https://stackoverflow.com/questions/34359129/operationcanceledexception-vs-taskcanceledexception-when-task-is-canceled
2024-11-29 14:57:43 +00:00
John Colvin 0e198e0ebf Hardcode webSocketUrl to aws server in DataStreamWebApp client 2024-11-29 14:57:43 +00:00
John Colvin 27a9bf66bb Assert that System publishers 'doWork' is always called on same thread 2024-11-29 14:57:43 +00:00
John Colvin 2a390c7c2e fix: Make InternalPublisherQueue thread safe 2024-11-29 14:57:43 +00:00
John Colvin ee0d444ae6 Improve error reporting in DataStreamWebSocketServer 2024-11-29 14:57:43 +00:00
John Colvin b058cde0ca data stream web app client check pt 2024-11-29 14:57:43 +00:00
John Colvin 39bb411bda fix build: Fix Spark build after making config init async 2024-11-29 14:57:43 +00:00
John Colvin 7423721c72 refactor: Tweak SparkCoreServices to synchronize Configuration.init globally 2024-11-29 14:57:43 +00:00
John Colvin ffbf7b5e8d refactor: Change Configuration.initialize to be async 2024-11-29 14:57:43 +00:00
John Colvin eb5aa9c3c7 vscode: Add 'isSparkApiEnabled' input to launch.json 2024-11-29 14:57:43 +00:00
John Colvin b90730fd11 SparkApiService check pt 2024-11-29 14:57:43 +00:00
John Colvin 142d530999 datastreamwebapp server checkpt 2024-11-29 14:57:43 +00:00
John Colvin a5670d2aaa datastream webapp client check pt 2024-11-29 14:57:43 +00:00
John Colvin 3179e9add3 Remove unused PubSubConfig props 2024-11-29 14:57:43 +00:00
John Colvin 8dae6e37e6 Fix dsqa config json 2024-11-29 14:57:43 +00:00
John Colvin eb0086d2c6 fix: Always call 'handle_internal_pubs' in PubSubMessageReactor main loop 2024-11-29 14:57:43 +00:00
John Colvin 0f680b1947 improvement: Accept CancellationToken, catch exceptions when running ds websocket server 2024-11-29 14:57:43 +00:00
John Colvin e4745a587f Fix mismatched types in PubSubServerTagStatsStream schema 2024-11-29 14:57:43 +00:00
John Colvin adfc0b5235 Add DataStreamPublisher service modules designed for Dependency Injection
* Change DataStreamPublisher json fields to match cs class property names verbatim
* Rename Publishers -> PublisherNodes in DataStreamPublisherConfig
2024-11-29 14:57:43 +00:00
John Colvin 30cf7ac5f9 refactor: Decouple ViewPublisher from IPubTableBroker impl 2024-11-29 14:57:43 +00:00
John Colvin 31b065c854 Add PubSub service modules designed for Dependency Injection
* Get rid of JsonPropertyName attributes in PubSubConfig
  - The Dependency Injection framework (based around dotnet ApplicationBuilder)
    does not support this attribute, and maps property names verbatim to json fields.

* Change PubSubServer json fields to match cs class property names verbatim
2024-11-29 14:57:43 +00:00
John Colvin 04a0cf9144 refactor: Decouple RemoteQueryManager from IManagedSubscriber, IPubTableBroker impl 2024-11-29 14:57:43 +00:00
John Colvin 37d6ffa27a refactor: Decouple ManagedSubscriber from ISubscriberCore impl 2024-11-29 14:57:43 +00:00
John Colvin 2760867093 refactor: Only support 1 tag type in IPubSubServerTagHandler 2024-11-29 14:57:43 +00:00
John Colvin 191de2ae46 refactor: Decouple PubTableBroker from IPublisherCore impl
Reference interface rather than the PublisherCore impl.
2024-11-29 14:57:43 +00:00
John Colvin 0b444d5f2f improvement: Accept CancellationToken in JsonRpcRequestObservable 2024-11-29 14:57:43 +00:00
John Colvin 702eac44d3 fix: Dispose market data sub in various md streams 2024-11-29 14:57:43 +00:00
John Colvin 30b23d36fa cleanup: Remove unused pubsub tag handler code
* Removed 'IPubSubServerTagHandler.register'
  - All implementations of this function were empty
* Removed 'IPubSubServerTagHandler.supportedTagTypes'
  - This property wasn't referenced anywhere
* Remove IWorker inheritance from IPubSubServerTagHandler
  - No reason these interfaces have to be tied together
2024-11-29 14:57:43 +00:00
John Colvin 202a9f6206 refactor: Rename CloudStreamManager.cs -> RemoteQueryManager.cs
This matches the file name
2024-11-29 14:57:43 +00:00
John Colvin 0d1966e752 Change pub sub schema prefix 'bluto://' -> 'bts-cloud://'
In config json files (not actual code change)
2024-11-29 14:57:43 +00:00
John Colvin a25905d55d fix build: Fix prop names after refactoring PubSubRoute
* Change 'server_address' -> 'ServerAddress'
* Change 'tag_reg_exp' -> 'TagRegExp'
2024-11-29 14:57:43 +00:00
John Colvin dddf14e356 build: Add scripts to publish data stream apps 2024-11-29 14:57:42 +00:00
John Colvin 962fd8712a Fix typo in log msg 2024-11-29 14:57:13 +00:00
John Colvin 7685b1f628 Fix build scripts so they propagate the exit code back to the shell
I noticed this was broken because launch.json configurations would still start the debugger
even when the preLaunchTask (build) failed!
2024-11-29 14:57:13 +00:00
John Colvin ef94ecf6a6 vscode: Add DataStreamPublisher debug cfg to skip build 2024-11-29 14:57:13 +00:00
John Colvin 26f9a76fc8 build: Use separate cmd to build DataStreamSuite/QueryAnalyzer.sln
The DataStreamSuite.sln builds the new webapp now, which will
(eventually) replace DSQA. We'll keep it around for now, but with a
clean separation from the main build.
2024-11-29 14:57:13 +00:00
John Colvin 806c204f08 feat: Add DataStream WebApp
Included in DataStreamSuite.sln, but not DataStreamQueryAnalyzer.sln
2024-11-29 14:57:13 +00:00
John Colvin 4aa3c67e87 Add spark service modules designed for Dependency Injection 2024-11-29 14:57:13 +00:00
John Colvin 614adac241 build: Copy libspark to all dotnet dirs in single cmake target
This is cleaner than the previous impl, which used separate build
targets to copy libspark to "net7.0", and "net7.0-windows" (dirs).
2024-11-29 14:57:13 +00:00
John Colvin 63ece377de fix: Parse ServerAddress as normal string
The "JsonValueOrArrayConverter<T>" doesn't work the way I thought it
would. When it is associated with a property via the JsonConverter
attribute, dotnet json parsing code throws an exception if "T" isn't
assignable to the property type.
2024-11-29 14:57:13 +00:00
John Colvin e49efc2bbf fix build (api server): Change namespace to bts.websocket_core 2024-11-29 14:57:13 +00:00