Commit Graph
228 Commits
Author SHA1 Message Date
John Colvin e4d6bc604b fix: Dispose existing sub on subscribe req in ds webapp
Even if new sub has parse error. This fixes a bug where the previous
subscription would continue firing and updating the frontend, when it
should just display the error info to the user and cease updates.
2024-10-14 17:21:46 +00:00
John Colvin 148a1bd5d4 fix: Get rid of "UseSpa" calls in webapp Production environment
This was leftover from a misguided attempt to fix a bug that turned out
to be due to an omitted environment var:
ASPNETCORE_HOSTINGSTARTUPASSEMBLIES=Microsoft.AspNetCore.SpaProxy
2024-10-14 17:21:46 +00:00
John Colvin f9084e24dd Tweak DataGrid style in DataStream WebApp 2024-10-14 17:21:46 +00:00
John Colvin 32c8589478 Add AwsProd config for DataStream WebApp 2024-10-14 17:21:46 +00:00
John Colvin 7e25b904b4 fix: Add VITE_ prefix to imported env vars
For the DataStream WebApp client
2024-10-14 17:21:46 +00:00
John Colvin a25afb9c64 Fix urls for DataStreamPublisher AwsProd.json 2024-10-14 17:21:46 +00:00
John Colvin f672d2221a Add benzinga news streams to AwsProd.json
This is a config profile for DataStreamPublisher, designed to be deployed
to aws (on public internet).
2024-10-14 17:21:46 +00:00
John Colvin 36f1596288 fix build warnings: Make props nullable strings in SharedStreamConfig 2024-10-14 17:21:46 +00:00
John Colvin d0f0ef12f5 whitespace: Format PubSubServer.json (indentation issues) 2024-10-14 17:21:46 +00:00
John Colvin ca326690a5 fix import from environment variable 2024-10-14 17:21:46 +00:00
John Colvin 263a051dd7 fix: Import websocket url from environment var 2024-10-14 17:21:46 +00:00
John Colvin 36f9e29520 Add scripts to deploy data stream apps 2024-10-14 17:21:46 +00:00
John Colvin ae8dd16e36 Add SpaServer to Production environment
For Bts.DataStreamWebApp.Server
2024-10-14 17:21:46 +00:00
John Colvin 26625e317e Change DirectoryBrowser requestPath to "/browse"
So we can view a psuedo file explorer for the webapp by requesting the "/browse" path
(only activated in Development environment).
2024-10-14 17:21:46 +00:00
John Colvin 38a3eebb13 cleanup: Remove unused code in Bts.DataStreamWebApp.Client 2024-10-14 17:21:46 +00:00
John Colvin e4ed09d96e Hardcode webSocketUrl to aws server in DataStreamWebApp client 2024-10-14 17:21:46 +00:00
John Colvin 6edb8b89f0 Assert that System publishers 'doWork' is always called on same thread 2024-10-14 17:21:46 +00:00
John Colvin b870e49d01 fix: Make InternalPublisherQueue thread safe 2024-10-14 17:21:46 +00:00
John Colvin f2e5ed35fb Improve error reporting in DataStreamWebSocketServer 2024-10-14 17:21:45 +00:00
John Colvin 368ffce5cf data stream web app client check pt 2024-10-14 17:21:45 +00:00
John Colvin 979eb50268 pubsub server checkpt 2024-10-14 17:21:45 +00:00
John Colvin 3960403d5a pubsub checkpt 2024-10-14 17:21:45 +00:00
John Colvin ff66151fc1 datastreamwebapp server checkpt 2024-10-14 17:21:45 +00:00
John Colvin 76dcc331e4 datastream webapp client check pt 2024-10-14 17:21:45 +00:00
John Colvin 037ce4a2b8 fix add pubsub services 2024-10-14 17:21:45 +00:00
John Colvin 96f0cfec1c Remove unused PubSubConfig props 2024-10-14 17:21:45 +00:00
John Colvin 6d013abe7a Fix dsqa config json 2024-10-14 17:21:45 +00:00
John Colvin 97691cceb3 fix: Always call 'handle_internal_pubs' in PubSubMessageReactor main loop 2024-10-14 17:21:45 +00:00
John Colvin 7a612502e9 improvement: Accept CancellationToken, catch exceptions when running ds websocket server 2024-10-14 17:21:45 +00:00
John Colvin 964f9a0b06 Fix mismatched types in PubSubServerTagStatsStream schema 2024-10-14 17:21:45 +00:00
John Colvin 5085e872cb Add DataStreamPublisher service modules designed for Dependency Injection
* Change DataStreamPublisher json fields to match cs class property names verbatim
* Rename Publishers -> PublisherNodes in DataStreamPublisherConfig
2024-10-14 17:21:45 +00:00
John Colvin c0fd30ab92 refactor: Decouple ViewPublisher from IPubTableBroker impl 2024-10-14 17:21:45 +00:00
John Colvin 40dfbd90d5 Add PubSub service modules designed for Dependency Injection
* Get rid of JsonPropertyName attributes in PubSubConfig
  - The Dependency Injection framework (based around dotnet ApplicationBuilder)
    does not support this attribute, and maps property names verbatim to json fields.

* Change PubSubServer json fields to match cs class property names verbatim
2024-10-14 17:21:45 +00:00
John Colvin 9411e8ed21 refactor: Decouple RemoteQueryManager from IManagedSubscriber, IPubTableBroker impl 2024-10-14 17:21:45 +00:00
John Colvin b6291d89e3 refactor: Decouple ManagedSubscriber from ISubscriberCore impl 2024-10-14 17:21:45 +00:00
John Colvin 4fb8b26812 refactor: Only support 1 tag type in IPubSubServerTagHandler 2024-10-14 17:21:45 +00:00
John Colvin 583932ea91 refactor: Decouple PubTableBroker from IPublisherCore impl
Reference interface rather than the PublisherCore impl.
2024-10-14 17:21:45 +00:00
John Colvin 1d76c0c0ed fix: Dispose market data sub in various md streams 2024-10-14 17:21:45 +00:00
John Colvin 89cb2b04bf cleanup: Remove unused pubsub tag handler code
* Removed 'IPubSubServerTagHandler.register'
  - All implementations of this function were empty
* Removed 'IPubSubServerTagHandler.supportedTagTypes'
  - This property wasn't referenced anywhere
* Remove IWorker inheritance from IPubSubServerTagHandler
  - No reason these interfaces have to be tied together
2024-10-14 17:21:45 +00:00
John Colvin 55f7a86500 refactor: Rename CloudStreamManager.cs -> RemoteQueryManager.cs
This matches the file name
2024-10-14 17:21:45 +00:00
John Colvin 86d01e73c4 Change pub sub schema prefix 'bluto://' -> 'bts-cloud://'
In config json files (not actual code change)
2024-10-14 17:21:45 +00:00
John Colvin 142aca7dc5 fix build: Fix prop names after refactoring PubSubRoute
* Change 'server_address' -> 'ServerAddress'
* Change 'tag_reg_exp' -> 'TagRegExp'
2024-10-14 17:21:45 +00:00
John Colvin d6983ab359 Fix typo in log msg 2024-10-14 17:21:45 +00:00
John Colvin fac11fdfe2 feat: Add DataStream WebApp
Included in DataStreamSuite.sln, but not DataStreamQueryAnalyzer.sln
2024-10-14 17:21:45 +00:00
John Colvin 4d2cac7216 fix: Parse ServerAddress as normal string
The "JsonValueOrArrayConverter<T>" doesn't work the way I thought it
would. When it is associated with a property via the JsonConverter
attribute, dotnet json parsing code throws an exception if "T" isn't
assignable to the property type.
2024-10-14 17:21:45 +00:00
John Colvin 9469906d4d fix build (warn): Only use Registry on windows 2024-10-14 17:21:45 +00:00
John Colvin de62ac6e82 cleanup: Fix numerous build warnings in DataStreamSuite
Nearly all warnings were due to nullability issues, since the concept of
nullable reference types did not exist when the DataStream code was
originally written.

* PubSubClientMessage
  - Normalize indentation/whitespace
  - Fix some typos
  - Address nullability issues to fix build warnings
  - Modernize code

* Compression related files
  - ZipEntry
  - ZipFile
  - ZipInputStream
  - TarHeader

* RemoteMessage
  - make 'message' nullable to resolve warnings elsewhere (in calling code)

* PubSubSingleTagStateEvent.cs
* PubSubMessageReactor
* PubSubState
* SystemHeartbeatPublisher
* SystemStatsPublisher
* SingleTagData
* ManagedTCPMessageHub
* PubsubDeserializationController
* PublisherCore
* InflaterHuffmanTree
* AsyncTCPConnection_APM
* ThreadSafeQueue
* ManagedSubscriber
* SubscriberCore
* PubSubServerManagedTCPConnection
* AsyncTCPConnection_APM
* SuperMapStream
* MapStream
* TradeBarsStream
2024-10-14 17:21:45 +00:00
John Colvin 4340910285 cleanup: Normalize indentation in TradeBarsStream 2024-10-14 17:21:45 +00:00
John Colvin 3b5e8d6e7e cleanup: Disable nullability warnings
* BZip2InputStream
* TarInputStream
* Inflater
* InflaterDynHeader
* BZip2OutputStream
* DeflaterHuffman
* ParallelJoinTest
2024-10-14 17:21:45 +00:00
John Colvin 2fab790ebf cleanup: Modernize PubSubRoute code, json parsing 2024-10-14 17:21:45 +00:00