John Colvin
1230424577
Fix urls for DataStreamPublisher AwsProd.json
2024-11-25 15:26:58 +00:00
John Colvin
9bbada0740
Add benzinga news streams to AwsProd.json
...
This is a config profile for DataStreamPublisher, designed to be deployed
to aws (on public internet).
2024-11-25 15:26:58 +00:00
John Colvin
44b3709c8f
fix build warnings: Make props nullable strings in SharedStreamConfig
2024-11-25 15:26:58 +00:00
John Colvin
cabcd406f7
whitespace: Format PubSubServer.json (indentation issues)
2024-11-25 15:26:58 +00:00
John Colvin
1c0026c108
Add a few tasks to run DataStream WebApp
2024-11-25 15:26:58 +00:00
John Colvin
11e862ae06
fix: Import websocket url from environment var
2024-11-25 15:26:58 +00:00
John Colvin
4deeacda4a
Add scripts to deploy data stream apps
2024-11-25 15:26:58 +00:00
John Colvin
9a0bf98b2c
Add SpaServer to Production environment
...
For Bts.DataStreamWebApp.Server
2024-11-25 15:26:58 +00:00
John Colvin
c286c3646b
Change DirectoryBrowser requestPath to "/browse"
...
So we can view a psuedo file explorer for the webapp by requesting the "/browse" path
(only activated in Development environment).
2024-11-25 15:26:58 +00:00
John Colvin
50596abce3
Publish Bts.DataStreamWebApp.Server along with PubSub & DataStream
2024-11-25 15:26:58 +00:00
John Colvin
324a6031ba
cleanup: Remove unused code in Bts.DataStreamWebApp.Client
2024-11-25 15:26:58 +00:00
John Colvin
94591eee6d
Capture OperationCanceledException (instead of TaskCanceledException)
...
The former is the base class for the latter, so this will widen the umbrella to catch a few corner cases
that would otherwise been handled by the generic "Exception" catch block. One corner case I know
of is when an op is canceled via "CancellationToken.ThrowIfCancellationRequested". In that case,
an OperationCanceledException is thrown (not a TaskCanceledException).
https://stackoverflow.com/questions/34359129/operationcanceledexception-vs-taskcanceledexception-when-task-is-canceled
2024-11-25 15:26:58 +00:00
John Colvin
41390da06a
Hardcode webSocketUrl to aws server in DataStreamWebApp client
2024-11-25 15:26:58 +00:00
John Colvin
9df9622ac2
Assert that System publishers 'doWork' is always called on same thread
2024-11-25 15:26:57 +00:00
John Colvin
4b965d1c3b
fix: Make InternalPublisherQueue thread safe
2024-11-25 15:26:57 +00:00
John Colvin
d485621d21
Improve error reporting in DataStreamWebSocketServer
2024-11-25 15:26:57 +00:00
John Colvin
b8678f6043
data stream web app client check pt
2024-11-25 15:26:57 +00:00
John Colvin
de15b0ea4b
fix build: Fix Spark build after making config init async
2024-11-25 15:26:57 +00:00
John Colvin
bd41e6cb52
refactor: Tweak SparkCoreServices to synchronize Configuration.init globally
2024-11-25 15:26:57 +00:00
John Colvin
f07b1f2e5f
refactor: Change Configuration.initialize to be async
2024-11-25 15:26:57 +00:00
John Colvin
a232261df5
vscode: Add 'isSparkApiEnabled' input to launch.json
2024-11-25 15:26:57 +00:00
John Colvin
c3cd8cf543
SparkApiService check pt
2024-11-25 15:26:57 +00:00
John Colvin
95814d3dae
datastreamwebapp server checkpt
2024-11-25 15:26:57 +00:00
John Colvin
c3ef18e649
datastream webapp client check pt
2024-11-25 15:26:57 +00:00
John Colvin
feaf2cc6b4
Remove unused PubSubConfig props
2024-11-25 15:26:57 +00:00
John Colvin
e184c850d1
Fix dsqa config json
2024-11-25 15:26:57 +00:00
John Colvin
161fdfa463
fix: Always call 'handle_internal_pubs' in PubSubMessageReactor main loop
2024-11-25 15:26:57 +00:00
John Colvin
9c184d7203
improvement: Accept CancellationToken, catch exceptions when running ds websocket server
2024-11-25 15:26:57 +00:00
John Colvin
a2344e1494
Fix mismatched types in PubSubServerTagStatsStream schema
2024-11-25 15:26:57 +00:00
John Colvin
cc153a1ced
Add DataStreamPublisher service modules designed for Dependency Injection
...
* Change DataStreamPublisher json fields to match cs class property names verbatim
* Rename Publishers -> PublisherNodes in DataStreamPublisherConfig
2024-11-25 15:26:57 +00:00
John Colvin
b19f720e42
refactor: Decouple ViewPublisher from IPubTableBroker impl
2024-11-25 15:26:57 +00:00
John Colvin
51d934de27
Add PubSub service modules designed for Dependency Injection
...
* Get rid of JsonPropertyName attributes in PubSubConfig
- The Dependency Injection framework (based around dotnet ApplicationBuilder)
does not support this attribute, and maps property names verbatim to json fields.
* Change PubSubServer json fields to match cs class property names verbatim
2024-11-25 15:26:57 +00:00
John Colvin
23e47f1749
refactor: Decouple RemoteQueryManager from IManagedSubscriber, IPubTableBroker impl
2024-11-25 15:26:57 +00:00
John Colvin
a5a905e20f
refactor: Decouple ManagedSubscriber from ISubscriberCore impl
2024-11-25 15:26:57 +00:00
John Colvin
1cecbe9276
refactor: Only support 1 tag type in IPubSubServerTagHandler
2024-11-25 15:26:57 +00:00
John Colvin
edfc1fc0d7
refactor: Decouple PubTableBroker from IPublisherCore impl
...
Reference interface rather than the PublisherCore impl.
2024-11-25 15:26:57 +00:00
John Colvin
cb43af0dd4
improvement: Accept CancellationToken in JsonRpcRequestObservable
2024-11-25 15:26:57 +00:00
John Colvin
70616d4a09
fix: Dispose market data sub in various md streams
2024-11-25 15:26:57 +00:00
John Colvin
6ec15d34a7
cleanup: Remove unused pubsub tag handler code
...
* Removed 'IPubSubServerTagHandler.register'
- All implementations of this function were empty
* Removed 'IPubSubServerTagHandler.supportedTagTypes'
- This property wasn't referenced anywhere
* Remove IWorker inheritance from IPubSubServerTagHandler
- No reason these interfaces have to be tied together
2024-11-25 15:26:57 +00:00
John Colvin
48b3852e6f
refactor: Rename CloudStreamManager.cs -> RemoteQueryManager.cs
...
This matches the file name
2024-11-25 15:26:57 +00:00
John Colvin
595656f298
Change pub sub schema prefix 'bluto://' -> 'bts-cloud://'
...
In config json files (not actual code change)
2024-11-25 15:26:57 +00:00
John Colvin
951d68e20c
fix build: Fix prop names after refactoring PubSubRoute
...
* Change 'server_address' -> 'ServerAddress'
* Change 'tag_reg_exp' -> 'TagRegExp'
2024-11-25 15:26:57 +00:00
John Colvin
d64ddb3477
build: Add scripts to publish data stream apps
2024-11-25 15:26:57 +00:00
John Colvin
d937054f6f
Fix typo in log msg
2024-11-25 15:26:57 +00:00
John Colvin
61affcf749
Fix build scripts so they propagate the exit code back to the shell
...
I noticed this was broken because launch.json configurations would still start the debugger
even when the preLaunchTask (build) failed!
2024-11-25 15:26:57 +00:00
John Colvin
7270967181
vscode: Add DataStreamPublisher debug cfg to skip build
2024-11-25 15:26:57 +00:00
John Colvin
008e84dcf0
build: Use separate cmd to build DataStreamSuite/QueryAnalyzer.sln
...
The DataStreamSuite.sln builds the new webapp now, which will
(eventually) replace DSQA. We'll keep it around for now, but with a
clean separation from the main build.
2024-11-25 15:26:57 +00:00
John Colvin
9cc0108a01
feat: Add DataStream WebApp
...
Included in DataStreamSuite.sln, but not DataStreamQueryAnalyzer.sln
2024-11-25 15:26:57 +00:00
John Colvin
6c1d1a43f5
Add spark service modules designed for Dependency Injection
2024-11-25 15:26:57 +00:00
John Colvin
d96b6da139
build: Copy libspark to all dotnet dirs in single cmake target
...
This is cleaner than the previous impl, which used separate build
targets to copy libspark to "net7.0", and "net7.0-windows" (dirs).
2024-11-25 15:26:57 +00:00