Commit Graph
13562 Commits
Author SHA1 Message Date
John Colvin 1230424577 Fix urls for DataStreamPublisher AwsProd.json 2024-11-25 15:26:58 +00:00
John Colvin 9bbada0740 Add benzinga news streams to AwsProd.json
This is a config profile for DataStreamPublisher, designed to be deployed
to aws (on public internet).
2024-11-25 15:26:58 +00:00
John Colvin 44b3709c8f fix build warnings: Make props nullable strings in SharedStreamConfig 2024-11-25 15:26:58 +00:00
John Colvin cabcd406f7 whitespace: Format PubSubServer.json (indentation issues) 2024-11-25 15:26:58 +00:00
John Colvin 1c0026c108 Add a few tasks to run DataStream WebApp 2024-11-25 15:26:58 +00:00
John Colvin 11e862ae06 fix: Import websocket url from environment var 2024-11-25 15:26:58 +00:00
John Colvin 4deeacda4a Add scripts to deploy data stream apps 2024-11-25 15:26:58 +00:00
John Colvin 9a0bf98b2c Add SpaServer to Production environment
For Bts.DataStreamWebApp.Server
2024-11-25 15:26:58 +00:00
John Colvin c286c3646b Change DirectoryBrowser requestPath to "/browse"
So we can view a psuedo file explorer for the webapp by requesting the "/browse" path
(only activated in Development environment).
2024-11-25 15:26:58 +00:00
John Colvin 50596abce3 Publish Bts.DataStreamWebApp.Server along with PubSub & DataStream 2024-11-25 15:26:58 +00:00
John Colvin 324a6031ba cleanup: Remove unused code in Bts.DataStreamWebApp.Client 2024-11-25 15:26:58 +00:00
John Colvin 94591eee6d Capture OperationCanceledException (instead of TaskCanceledException)
The former is the base class for the latter, so this will widen the umbrella to catch a few corner cases
that would otherwise been handled by the generic "Exception" catch block. One corner case I know
of is when an op is canceled via "CancellationToken.ThrowIfCancellationRequested". In that case,
an OperationCanceledException is thrown (not a TaskCanceledException).

https://stackoverflow.com/questions/34359129/operationcanceledexception-vs-taskcanceledexception-when-task-is-canceled
2024-11-25 15:26:58 +00:00
John Colvin 41390da06a Hardcode webSocketUrl to aws server in DataStreamWebApp client 2024-11-25 15:26:58 +00:00
John Colvin 9df9622ac2 Assert that System publishers 'doWork' is always called on same thread 2024-11-25 15:26:57 +00:00
John Colvin 4b965d1c3b fix: Make InternalPublisherQueue thread safe 2024-11-25 15:26:57 +00:00
John Colvin d485621d21 Improve error reporting in DataStreamWebSocketServer 2024-11-25 15:26:57 +00:00
John Colvin b8678f6043 data stream web app client check pt 2024-11-25 15:26:57 +00:00
John Colvin de15b0ea4b fix build: Fix Spark build after making config init async 2024-11-25 15:26:57 +00:00
John Colvin bd41e6cb52 refactor: Tweak SparkCoreServices to synchronize Configuration.init globally 2024-11-25 15:26:57 +00:00
John Colvin f07b1f2e5f refactor: Change Configuration.initialize to be async 2024-11-25 15:26:57 +00:00
John Colvin a232261df5 vscode: Add 'isSparkApiEnabled' input to launch.json 2024-11-25 15:26:57 +00:00
John Colvin c3cd8cf543 SparkApiService check pt 2024-11-25 15:26:57 +00:00
John Colvin 95814d3dae datastreamwebapp server checkpt 2024-11-25 15:26:57 +00:00
John Colvin c3ef18e649 datastream webapp client check pt 2024-11-25 15:26:57 +00:00
John Colvin feaf2cc6b4 Remove unused PubSubConfig props 2024-11-25 15:26:57 +00:00
John Colvin e184c850d1 Fix dsqa config json 2024-11-25 15:26:57 +00:00
John Colvin 161fdfa463 fix: Always call 'handle_internal_pubs' in PubSubMessageReactor main loop 2024-11-25 15:26:57 +00:00
John Colvin 9c184d7203 improvement: Accept CancellationToken, catch exceptions when running ds websocket server 2024-11-25 15:26:57 +00:00
John Colvin a2344e1494 Fix mismatched types in PubSubServerTagStatsStream schema 2024-11-25 15:26:57 +00:00
John Colvin cc153a1ced Add DataStreamPublisher service modules designed for Dependency Injection
* Change DataStreamPublisher json fields to match cs class property names verbatim
* Rename Publishers -> PublisherNodes in DataStreamPublisherConfig
2024-11-25 15:26:57 +00:00
John Colvin b19f720e42 refactor: Decouple ViewPublisher from IPubTableBroker impl 2024-11-25 15:26:57 +00:00
John Colvin 51d934de27 Add PubSub service modules designed for Dependency Injection
* Get rid of JsonPropertyName attributes in PubSubConfig
  - The Dependency Injection framework (based around dotnet ApplicationBuilder)
    does not support this attribute, and maps property names verbatim to json fields.

* Change PubSubServer json fields to match cs class property names verbatim
2024-11-25 15:26:57 +00:00
John Colvin 23e47f1749 refactor: Decouple RemoteQueryManager from IManagedSubscriber, IPubTableBroker impl 2024-11-25 15:26:57 +00:00
John Colvin a5a905e20f refactor: Decouple ManagedSubscriber from ISubscriberCore impl 2024-11-25 15:26:57 +00:00
John Colvin 1cecbe9276 refactor: Only support 1 tag type in IPubSubServerTagHandler 2024-11-25 15:26:57 +00:00
John Colvin edfc1fc0d7 refactor: Decouple PubTableBroker from IPublisherCore impl
Reference interface rather than the PublisherCore impl.
2024-11-25 15:26:57 +00:00
John Colvin cb43af0dd4 improvement: Accept CancellationToken in JsonRpcRequestObservable 2024-11-25 15:26:57 +00:00
John Colvin 70616d4a09 fix: Dispose market data sub in various md streams 2024-11-25 15:26:57 +00:00
John Colvin 6ec15d34a7 cleanup: Remove unused pubsub tag handler code
* Removed 'IPubSubServerTagHandler.register'
  - All implementations of this function were empty
* Removed 'IPubSubServerTagHandler.supportedTagTypes'
  - This property wasn't referenced anywhere
* Remove IWorker inheritance from IPubSubServerTagHandler
  - No reason these interfaces have to be tied together
2024-11-25 15:26:57 +00:00
John Colvin 48b3852e6f refactor: Rename CloudStreamManager.cs -> RemoteQueryManager.cs
This matches the file name
2024-11-25 15:26:57 +00:00
John Colvin 595656f298 Change pub sub schema prefix 'bluto://' -> 'bts-cloud://'
In config json files (not actual code change)
2024-11-25 15:26:57 +00:00
John Colvin 951d68e20c fix build: Fix prop names after refactoring PubSubRoute
* Change 'server_address' -> 'ServerAddress'
* Change 'tag_reg_exp' -> 'TagRegExp'
2024-11-25 15:26:57 +00:00
John Colvin d64ddb3477 build: Add scripts to publish data stream apps 2024-11-25 15:26:57 +00:00
John Colvin d937054f6f Fix typo in log msg 2024-11-25 15:26:57 +00:00
John Colvin 61affcf749 Fix build scripts so they propagate the exit code back to the shell
I noticed this was broken because launch.json configurations would still start the debugger
even when the preLaunchTask (build) failed!
2024-11-25 15:26:57 +00:00
John Colvin 7270967181 vscode: Add DataStreamPublisher debug cfg to skip build 2024-11-25 15:26:57 +00:00
John Colvin 008e84dcf0 build: Use separate cmd to build DataStreamSuite/QueryAnalyzer.sln
The DataStreamSuite.sln builds the new webapp now, which will
(eventually) replace DSQA. We'll keep it around for now, but with a
clean separation from the main build.
2024-11-25 15:26:57 +00:00
John Colvin 9cc0108a01 feat: Add DataStream WebApp
Included in DataStreamSuite.sln, but not DataStreamQueryAnalyzer.sln
2024-11-25 15:26:57 +00:00
John Colvin 6c1d1a43f5 Add spark service modules designed for Dependency Injection 2024-11-25 15:26:57 +00:00
John Colvin d96b6da139 build: Copy libspark to all dotnet dirs in single cmake target
This is cleaner than the previous impl, which used separate build
targets to copy libspark to "net7.0", and "net7.0-windows" (dirs).
2024-11-25 15:26:57 +00:00