Commit Graph
230 Commits
Author SHA1 Message Date
John Colvin 9faf0d69d4 Improve error display in ds webapp 2024-10-21 13:29:58 +00:00
John Colvin c81e84fce1 fix: Dispose existing sub on subscribe req in ds webapp
Even if new sub has parse error. This fixes a bug where the previous
subscription would continue firing and updating the frontend, when it
should just display the error info to the user and cease updates.
2024-10-21 13:29:58 +00:00
John Colvin d1dc6c6e6b fix: Get rid of "UseSpa" calls in webapp Production environment
This was leftover from a misguided attempt to fix a bug that turned out
to be due to an omitted environment var:
ASPNETCORE_HOSTINGSTARTUPASSEMBLIES=Microsoft.AspNetCore.SpaProxy
2024-10-21 13:29:58 +00:00
John Colvin bda7052e40 Tweak DataGrid style in DataStream WebApp 2024-10-21 13:29:58 +00:00
John Colvin 4710d3e072 Add AwsProd config for DataStream WebApp 2024-10-21 13:29:58 +00:00
John Colvin bafc7340fa fix: Add VITE_ prefix to imported env vars
For the DataStream WebApp client
2024-10-21 13:29:58 +00:00
John Colvin 0f2f4df3c5 Fix urls for DataStreamPublisher AwsProd.json 2024-10-21 13:29:58 +00:00
John Colvin bf66d39b27 Add benzinga news streams to AwsProd.json
This is a config profile for DataStreamPublisher, designed to be deployed
to aws (on public internet).
2024-10-21 13:29:58 +00:00
John Colvin a34836540e fix build warnings: Make props nullable strings in SharedStreamConfig 2024-10-21 13:29:58 +00:00
John Colvin e855f136a1 whitespace: Format PubSubServer.json (indentation issues) 2024-10-21 13:29:58 +00:00
John Colvin 41115204f3 fix import from environment variable 2024-10-21 13:29:58 +00:00
John Colvin 9f7353d5b6 fix: Import websocket url from environment var 2024-10-21 13:29:58 +00:00
John Colvin 894add7df6 Add scripts to deploy data stream apps 2024-10-21 13:29:58 +00:00
John Colvin 73ce6d129e Add SpaServer to Production environment
For Bts.DataStreamWebApp.Server
2024-10-21 13:29:58 +00:00
John Colvin ad2bd712c5 Change DirectoryBrowser requestPath to "/browse"
So we can view a psuedo file explorer for the webapp by requesting the "/browse" path
(only activated in Development environment).
2024-10-21 13:29:58 +00:00
John Colvin 928ba5d056 cleanup: Remove unused code in Bts.DataStreamWebApp.Client 2024-10-21 13:29:58 +00:00
John Colvin 6a18eaf122 Hardcode webSocketUrl to aws server in DataStreamWebApp client 2024-10-21 13:29:58 +00:00
John Colvin 1b40083008 Assert that System publishers 'doWork' is always called on same thread 2024-10-21 13:29:58 +00:00
John Colvin b381ce0154 fix: Make InternalPublisherQueue thread safe 2024-10-21 13:29:58 +00:00
John Colvin 2fef1ceb99 Improve error reporting in DataStreamWebSocketServer 2024-10-21 13:29:58 +00:00
John Colvin 08c2b2a7f2 data stream web app client check pt 2024-10-21 13:29:58 +00:00
John Colvin 824912383f pubsub server checkpt 2024-10-21 13:29:58 +00:00
John Colvin 347d5e75a6 pubsub checkpt 2024-10-21 13:29:58 +00:00
John Colvin d0d2934e37 datastreamwebapp server checkpt 2024-10-21 13:29:58 +00:00
John Colvin 22ced681c1 datastream webapp client check pt 2024-10-21 13:29:58 +00:00
John Colvin a9b91de56a fix add pubsub services 2024-10-21 13:29:58 +00:00
John Colvin 6dc4387867 Remove unused PubSubConfig props 2024-10-21 13:29:58 +00:00
John Colvin 6e9fa7b6f7 Fix dsqa config json 2024-10-21 13:29:58 +00:00
John Colvin 16c3223eb5 fix: Always call 'handle_internal_pubs' in PubSubMessageReactor main loop 2024-10-21 13:29:58 +00:00
John Colvin f79335fcc0 improvement: Accept CancellationToken, catch exceptions when running ds websocket server 2024-10-21 13:29:58 +00:00
John Colvin 57f8e1f29b Fix mismatched types in PubSubServerTagStatsStream schema 2024-10-21 13:29:58 +00:00
John Colvin bab9a4cd7b Add DataStreamPublisher service modules designed for Dependency Injection
* Change DataStreamPublisher json fields to match cs class property names verbatim
* Rename Publishers -> PublisherNodes in DataStreamPublisherConfig
2024-10-21 13:29:57 +00:00
John Colvin dde07b16f5 refactor: Decouple ViewPublisher from IPubTableBroker impl 2024-10-21 13:29:57 +00:00
John Colvin ac80c8ed1d Add PubSub service modules designed for Dependency Injection
* Get rid of JsonPropertyName attributes in PubSubConfig
  - The Dependency Injection framework (based around dotnet ApplicationBuilder)
    does not support this attribute, and maps property names verbatim to json fields.

* Change PubSubServer json fields to match cs class property names verbatim
2024-10-21 13:29:57 +00:00
John Colvin 90aeb7b855 refactor: Decouple RemoteQueryManager from IManagedSubscriber, IPubTableBroker impl 2024-10-21 13:29:57 +00:00
John Colvin ef1c2c7032 refactor: Decouple ManagedSubscriber from ISubscriberCore impl 2024-10-21 13:29:57 +00:00
John Colvin ef2c56e1bd refactor: Only support 1 tag type in IPubSubServerTagHandler 2024-10-21 13:29:57 +00:00
John Colvin 958bc3d233 refactor: Decouple PubTableBroker from IPublisherCore impl
Reference interface rather than the PublisherCore impl.
2024-10-21 13:29:57 +00:00
John Colvin 656eef4dbd fix: Dispose market data sub in various md streams 2024-10-21 13:29:57 +00:00
John Colvin 6b298f3eaa cleanup: Remove unused pubsub tag handler code
* Removed 'IPubSubServerTagHandler.register'
  - All implementations of this function were empty
* Removed 'IPubSubServerTagHandler.supportedTagTypes'
  - This property wasn't referenced anywhere
* Remove IWorker inheritance from IPubSubServerTagHandler
  - No reason these interfaces have to be tied together
2024-10-21 13:29:57 +00:00
John Colvin 03d1b1967e refactor: Rename CloudStreamManager.cs -> RemoteQueryManager.cs
This matches the file name
2024-10-21 13:29:57 +00:00
John Colvin 6fee2750a3 Change pub sub schema prefix 'bluto://' -> 'bts-cloud://'
In config json files (not actual code change)
2024-10-21 13:29:57 +00:00
John Colvin 8f5c66493e fix build: Fix prop names after refactoring PubSubRoute
* Change 'server_address' -> 'ServerAddress'
* Change 'tag_reg_exp' -> 'TagRegExp'
2024-10-21 13:29:57 +00:00
John Colvin ae2ab08f5b Fix typo in log msg 2024-10-21 13:29:57 +00:00
John Colvin add3aa8bd3 feat: Add DataStream WebApp
Included in DataStreamSuite.sln, but not DataStreamQueryAnalyzer.sln
2024-10-21 13:29:57 +00:00
John Colvin 6d5464bb92 fix: Parse ServerAddress as normal string
The "JsonValueOrArrayConverter<T>" doesn't work the way I thought it
would. When it is associated with a property via the JsonConverter
attribute, dotnet json parsing code throws an exception if "T" isn't
assignable to the property type.
2024-10-21 13:29:57 +00:00
John Colvin 6c0f898c4a fix build (warn): Only use Registry on windows 2024-10-21 13:29:57 +00:00
John Colvin b210296056 cleanup: Fix numerous build warnings in DataStreamSuite
Nearly all warnings were due to nullability issues, since the concept of
nullable reference types did not exist when the DataStream code was
originally written.

* PubSubClientMessage
  - Normalize indentation/whitespace
  - Fix some typos
  - Address nullability issues to fix build warnings
  - Modernize code

* Compression related files
  - ZipEntry
  - ZipFile
  - ZipInputStream
  - TarHeader

* RemoteMessage
  - make 'message' nullable to resolve warnings elsewhere (in calling code)

* PubSubSingleTagStateEvent.cs
* PubSubMessageReactor
* PubSubState
* SystemHeartbeatPublisher
* SystemStatsPublisher
* SingleTagData
* ManagedTCPMessageHub
* PubsubDeserializationController
* PublisherCore
* InflaterHuffmanTree
* AsyncTCPConnection_APM
* ThreadSafeQueue
* ManagedSubscriber
* SubscriberCore
* PubSubServerManagedTCPConnection
* AsyncTCPConnection_APM
* SuperMapStream
* MapStream
* TradeBarsStream
2024-10-21 13:29:57 +00:00
John Colvin 5b30cd05f9 cleanup: Normalize indentation in TradeBarsStream 2024-10-21 13:29:57 +00:00
John Colvin 8dabbb6122 cleanup: Disable nullability warnings
* BZip2InputStream
* TarInputStream
* Inflater
* InflaterDynHeader
* BZip2OutputStream
* DeflaterHuffman
* ParallelJoinTest
2024-10-21 13:29:57 +00:00