Commit Graph
234 Commits
Author SHA1 Message Date
John Colvin da14a2b4ae fix: Copy canned queries to clipboard on click
Instead of trying to update the text directly, which causes the front end
to overwrite the user's changes everytime the data updates from then on.
2024-11-29 14:57:43 +00:00
John Colvin 6fd6a0dd55 fix: Convert invalid doubles to nan in ds webapp serializer 2024-11-29 14:57:43 +00:00
John Colvin b9a5e91cad Increase datagrid maxheight in ds webapp to 1000px 2024-11-29 14:57:43 +00:00
John Colvin 2770e01726 Improve error display in ds webapp 2024-11-29 14:57:43 +00:00
John Colvin 0777e3f160 fix: Dispose existing sub on subscribe req in ds webapp
Even if new sub has parse error. This fixes a bug where the previous
subscription would continue firing and updating the frontend, when it
should just display the error info to the user and cease updates.
2024-11-29 14:57:43 +00:00
John Colvin 1eb3075569 fix: Get rid of "UseSpa" calls in webapp Production environment
This was leftover from a misguided attempt to fix a bug that turned out
to be due to an omitted environment var:
ASPNETCORE_HOSTINGSTARTUPASSEMBLIES=Microsoft.AspNetCore.SpaProxy
2024-11-29 14:57:43 +00:00
John Colvin 729e9f35ae Tweak DataGrid style in DataStream WebApp 2024-11-29 14:57:43 +00:00
John Colvin 316f49227d Add AwsProd config for DataStream WebApp 2024-11-29 14:57:43 +00:00
John Colvin c59345dc0a fix: Add VITE_ prefix to imported env vars
For the DataStream WebApp client
2024-11-29 14:57:43 +00:00
John Colvin 2e0c9c8d54 Fix urls for DataStreamPublisher AwsProd.json 2024-11-29 14:57:43 +00:00
John Colvin e3ad222015 Add benzinga news streams to AwsProd.json
This is a config profile for DataStreamPublisher, designed to be deployed
to aws (on public internet).
2024-11-29 14:57:43 +00:00
John Colvin b18facfa87 fix build warnings: Make props nullable strings in SharedStreamConfig 2024-11-29 14:57:43 +00:00
John Colvin 397f6156dc whitespace: Format PubSubServer.json (indentation issues) 2024-11-29 14:57:43 +00:00
John Colvin d277495610 fix: Import websocket url from environment var 2024-11-29 14:57:43 +00:00
John Colvin 250f34e3de Add scripts to deploy data stream apps 2024-11-29 14:57:43 +00:00
John Colvin 00c06429b1 Add SpaServer to Production environment
For Bts.DataStreamWebApp.Server
2024-11-29 14:57:43 +00:00
John Colvin 254e3d38af Change DirectoryBrowser requestPath to "/browse"
So we can view a psuedo file explorer for the webapp by requesting the "/browse" path
(only activated in Development environment).
2024-11-29 14:57:43 +00:00
John Colvin fc40ea412f cleanup: Remove unused code in Bts.DataStreamWebApp.Client 2024-11-29 14:57:43 +00:00
John Colvin 0e198e0ebf Hardcode webSocketUrl to aws server in DataStreamWebApp client 2024-11-29 14:57:43 +00:00
John Colvin 27a9bf66bb Assert that System publishers 'doWork' is always called on same thread 2024-11-29 14:57:43 +00:00
John Colvin 2a390c7c2e fix: Make InternalPublisherQueue thread safe 2024-11-29 14:57:43 +00:00
John Colvin ee0d444ae6 Improve error reporting in DataStreamWebSocketServer 2024-11-29 14:57:43 +00:00
John Colvin b058cde0ca data stream web app client check pt 2024-11-29 14:57:43 +00:00
John Colvin 142d530999 datastreamwebapp server checkpt 2024-11-29 14:57:43 +00:00
John Colvin a5670d2aaa datastream webapp client check pt 2024-11-29 14:57:43 +00:00
John Colvin 3179e9add3 Remove unused PubSubConfig props 2024-11-29 14:57:43 +00:00
John Colvin 8dae6e37e6 Fix dsqa config json 2024-11-29 14:57:43 +00:00
John Colvin eb0086d2c6 fix: Always call 'handle_internal_pubs' in PubSubMessageReactor main loop 2024-11-29 14:57:43 +00:00
John Colvin 0f680b1947 improvement: Accept CancellationToken, catch exceptions when running ds websocket server 2024-11-29 14:57:43 +00:00
John Colvin e4745a587f Fix mismatched types in PubSubServerTagStatsStream schema 2024-11-29 14:57:43 +00:00
John Colvin adfc0b5235 Add DataStreamPublisher service modules designed for Dependency Injection
* Change DataStreamPublisher json fields to match cs class property names verbatim
* Rename Publishers -> PublisherNodes in DataStreamPublisherConfig
2024-11-29 14:57:43 +00:00
John Colvin 30cf7ac5f9 refactor: Decouple ViewPublisher from IPubTableBroker impl 2024-11-29 14:57:43 +00:00
John Colvin 31b065c854 Add PubSub service modules designed for Dependency Injection
* Get rid of JsonPropertyName attributes in PubSubConfig
  - The Dependency Injection framework (based around dotnet ApplicationBuilder)
    does not support this attribute, and maps property names verbatim to json fields.

* Change PubSubServer json fields to match cs class property names verbatim
2024-11-29 14:57:43 +00:00
John Colvin 04a0cf9144 refactor: Decouple RemoteQueryManager from IManagedSubscriber, IPubTableBroker impl 2024-11-29 14:57:43 +00:00
John Colvin 37d6ffa27a refactor: Decouple ManagedSubscriber from ISubscriberCore impl 2024-11-29 14:57:43 +00:00
John Colvin 2760867093 refactor: Only support 1 tag type in IPubSubServerTagHandler 2024-11-29 14:57:43 +00:00
John Colvin 191de2ae46 refactor: Decouple PubTableBroker from IPublisherCore impl
Reference interface rather than the PublisherCore impl.
2024-11-29 14:57:43 +00:00
John Colvin 702eac44d3 fix: Dispose market data sub in various md streams 2024-11-29 14:57:43 +00:00
John Colvin 30b23d36fa cleanup: Remove unused pubsub tag handler code
* Removed 'IPubSubServerTagHandler.register'
  - All implementations of this function were empty
* Removed 'IPubSubServerTagHandler.supportedTagTypes'
  - This property wasn't referenced anywhere
* Remove IWorker inheritance from IPubSubServerTagHandler
  - No reason these interfaces have to be tied together
2024-11-29 14:57:43 +00:00
John Colvin 202a9f6206 refactor: Rename CloudStreamManager.cs -> RemoteQueryManager.cs
This matches the file name
2024-11-29 14:57:43 +00:00
John Colvin 0d1966e752 Change pub sub schema prefix 'bluto://' -> 'bts-cloud://'
In config json files (not actual code change)
2024-11-29 14:57:43 +00:00
John Colvin a25905d55d fix build: Fix prop names after refactoring PubSubRoute
* Change 'server_address' -> 'ServerAddress'
* Change 'tag_reg_exp' -> 'TagRegExp'
2024-11-29 14:57:43 +00:00
John Colvin 962fd8712a Fix typo in log msg 2024-11-29 14:57:13 +00:00
John Colvin 806c204f08 feat: Add DataStream WebApp
Included in DataStreamSuite.sln, but not DataStreamQueryAnalyzer.sln
2024-11-29 14:57:13 +00:00
John Colvin 63ece377de fix: Parse ServerAddress as normal string
The "JsonValueOrArrayConverter<T>" doesn't work the way I thought it
would. When it is associated with a property via the JsonConverter
attribute, dotnet json parsing code throws an exception if "T" isn't
assignable to the property type.
2024-11-29 14:57:13 +00:00
John Colvin ca0cc90a24 fix build (warn): Only use Registry on windows 2024-11-29 14:57:13 +00:00
John Colvin ce2c3d930a cleanup: Fix numerous build warnings in DataStreamSuite
Nearly all warnings were due to nullability issues, since the concept of
nullable reference types did not exist when the DataStream code was
originally written.

* PubSubClientMessage
  - Normalize indentation/whitespace
  - Fix some typos
  - Address nullability issues to fix build warnings
  - Modernize code

* Compression related files
  - ZipEntry
  - ZipFile
  - ZipInputStream
  - TarHeader

* RemoteMessage
  - make 'message' nullable to resolve warnings elsewhere (in calling code)

* PubSubSingleTagStateEvent.cs
* PubSubMessageReactor
* PubSubState
* SystemHeartbeatPublisher
* SystemStatsPublisher
* SingleTagData
* ManagedTCPMessageHub
* PubsubDeserializationController
* PublisherCore
* InflaterHuffmanTree
* AsyncTCPConnection_APM
* ThreadSafeQueue
* ManagedSubscriber
* SubscriberCore
* PubSubServerManagedTCPConnection
* AsyncTCPConnection_APM
* SuperMapStream
* MapStream
* TradeBarsStream
2024-11-29 14:57:13 +00:00
John Colvin e7725233e4 cleanup: Disable nullability warnings
* BZip2InputStream
* TarInputStream
* Inflater
* InflaterDynHeader
* BZip2OutputStream
* DeflaterHuffman
* ParallelJoinTest
2024-11-29 14:57:13 +00:00
John Colvin 6ed6b65027 cleanup: Modernize PubSubRoute code, json parsing 2024-11-29 14:57:13 +00:00
John Colvin 899e57cfef cleanup: Remove unused DateTime grammar from exp parser 2024-11-29 14:57:13 +00:00