Commit Graph
11953 Commits
Author SHA1 Message Date
John Colvin 8194a07a8e SparkApiService check pt 2024-09-22 18:33:42 +00:00
John Colvin d8e4c6e601 pubsub server checkpt 2024-09-22 18:33:42 +00:00
John Colvin a8d3528125 pubsub checkpt 2024-09-22 18:33:42 +00:00
John Colvin 655329fec8 datastreamwebapp server checkpt 2024-09-22 18:33:41 +00:00
John Colvin 7d7c868f87 datastream webapp client check pt 2024-09-22 18:33:41 +00:00
John Colvin c14bade720 fix add pubsub services 2024-09-22 18:33:41 +00:00
John Colvin 104de5df7b Remove unused PubSubConfig props 2024-09-22 18:33:41 +00:00
John Colvin bd52ef0a8e Fix dsqa config json 2024-09-19 20:03:31 +00:00
John Colvin a015ff98e4 fix: Always call 'handle_internal_pubs' in PubSubMessageReactor main loop 2024-09-19 20:03:31 +00:00
John Colvin 12fc295825 improvement: Accept CancellationToken, catch exceptions when running ds websocket server 2024-09-19 20:03:31 +00:00
John Colvin 587e853f21 Fix mismatched types in PubSubServerTagStatsStream schema 2024-09-19 20:03:31 +00:00
John Colvin 909c8f5bcd Add DataStreamPublisher service modules designed for Dependency Injection
* Change DataStreamPublisher json fields to match cs class property names verbatim
* Rename Publishers -> PublisherNodes in DataStreamPublisherConfig
2024-09-19 20:03:31 +00:00
John Colvin 448d49f38d refactor: Decouple ViewPublisher from IPubTableBroker impl 2024-09-19 20:03:31 +00:00
John Colvin f67c24f7f5 Add PubSub service modules designed for Dependency Injection
* Get rid of JsonPropertyName attributes in PubSubConfig
  - The Dependency Injection framework (based around dotnet ApplicationBuilder)
    does not support this attribute, and maps property names verbatim to json fields.

* Change PubSubServer json fields to match cs class property names verbatim
2024-09-19 20:03:31 +00:00
John Colvin 69a72a1035 refactor: Decouple RemoteQueryManager from IManagedSubscriber, IPubTableBroker impl 2024-09-19 20:03:31 +00:00
John Colvin 819a8f6c22 refactor: Decouple ManagedSubscriber from ISubscriberCore impl 2024-09-19 20:03:31 +00:00
John Colvin 42db20316b refactor: Only support 1 tag type in IPubSubServerTagHandler 2024-09-19 20:03:31 +00:00
John Colvin 633a8590a1 refactor: Decouple PubTableBroker from IPublisherCore impl
Reference interface rather than the PublisherCore impl.
2024-09-19 20:03:31 +00:00
John Colvin eff979fb2b improvement: Accept CancellationToken in JsonRpcRequestObservable 2024-09-19 20:03:31 +00:00
John Colvin 23771909fd fix: Dispose market data sub in various md streams 2024-09-19 20:03:31 +00:00
John Colvin 9de21a3116 cleanup: Remove unused pubsub tag handler code
* Removed 'IPubSubServerTagHandler.register'
  - All implementations of this function were empty
* Removed 'IPubSubServerTagHandler.supportedTagTypes'
  - This property wasn't referenced anywhere
* Remove IWorker inheritance from IPubSubServerTagHandler
  - No reason these interfaces have to be tied together
2024-09-19 20:03:31 +00:00
John Colvin 8d231ce46c refactor: Rename CloudStreamManager.cs -> RemoteQueryManager.cs
This matches the file name
2024-09-19 20:03:31 +00:00
John Colvin fc9d5ab04f Change pub sub schema prefix 'bluto://' -> 'bts-cloud://'
In config json files (not actual code change)
2024-09-19 20:03:29 +00:00
John Colvin 3562f6848e fix build: Fix prop names after refactoring PubSubRoute
* Change 'server_address' -> 'ServerAddress'
* Change 'tag_reg_exp' -> 'TagRegExp'
2024-09-19 20:02:09 +00:00
John Colvin b4c902c023 Fix typo in log msg 2024-09-19 20:02:09 +00:00
John Colvin 2dfa44c1e4 feat: Add DataStream WebApp
Included in DataStreamSuite.sln, but not DataStreamQueryAnalyzer.sln
2024-09-19 20:02:09 +00:00
John Colvin 022cad3122 Add spark service modules designed for Dependency Injection 2024-09-19 20:02:09 +00:00
John Colvin 5c42b4fe8b build: Copy libspark to all dotnet dirs in single cmake target
This is cleaner than the previous impl, which used separate build
targets to copy libspark to "net7.0", and "net7.0-windows" (dirs).
2024-09-19 20:02:09 +00:00
John Colvin 9f81c0ab39 fix: Parse ServerAddress as normal string
The "JsonValueOrArrayConverter<T>" doesn't work the way I thought it
would. When it is associated with a property via the JsonConverter
attribute, dotnet json parsing code throws an exception if "T" isn't
assignable to the property type.
2024-09-19 20:02:09 +00:00
John Colvin c941fa78d2 fix build (api server): Change namespace to bts.websocket_core 2024-09-19 20:02:09 +00:00
John Colvin 565c70bb92 fix build (warn): Only use Registry on windows 2024-09-19 20:02:09 +00:00
John Colvin 97bc186110 cleanup: Fix numerous build warnings in DataStreamSuite
Nearly all warnings were due to nullability issues, since the concept of
nullable reference types did not exist when the DataStream code was
originally written.

* PubSubClientMessage
  - Normalize indentation/whitespace
  - Fix some typos
  - Address nullability issues to fix build warnings
  - Modernize code

* Compression related files
  - ZipEntry
  - ZipFile
  - ZipInputStream
  - TarHeader

* RemoteMessage
  - make 'message' nullable to resolve warnings elsewhere (in calling code)

* PubSubSingleTagStateEvent.cs
* PubSubMessageReactor
* PubSubState
* SystemHeartbeatPublisher
* SystemStatsPublisher
* SingleTagData
* ManagedTCPMessageHub
* PubsubDeserializationController
* PublisherCore
* InflaterHuffmanTree
* AsyncTCPConnection_APM
* ThreadSafeQueue
* ManagedSubscriber
* SubscriberCore
* PubSubServerManagedTCPConnection
* AsyncTCPConnection_APM
* SuperMapStream
* MapStream
* TradeBarsStream
2024-09-19 20:02:09 +00:00
John Colvin 158f4fb6c8 cleanup: Normalize indentation in TradeBarsStream 2024-09-19 20:02:09 +00:00
John Colvin c7961f53c0 cleanup: Disable nullability warnings
* BZip2InputStream
* TarInputStream
* Inflater
* InflaterDynHeader
* BZip2OutputStream
* DeflaterHuffman
* ParallelJoinTest
2024-09-19 20:02:09 +00:00
John Colvin 6e89f42bc8 cleanup: Modernize PubSubRoute code, json parsing 2024-09-19 20:02:09 +00:00
John Colvin 0ee450b12a cleanup: Remove unused DateTime grammar from exp parser 2024-09-19 20:02:09 +00:00
John Colvin b2e3a6bf82 Add JsonRpcRequestObservable, AsyncEnumerable 2024-09-19 20:02:09 +00:00
John Colvin f87aa6c4b6 Add json facilities for DataStream websocket api 2024-09-19 20:02:09 +00:00
John Colvin 40a46dd6d7 refactor: Add handy WebsocketExtensions
* IsSocketStateOpen
* IsClosedProperly
2024-09-19 20:02:09 +00:00
John Colvin 75d04b2cd2 feat: Add JsonRpc types for websocket paradigm 2024-09-19 20:02:09 +00:00
John Colvin 423e20ae41 cleanup: Remove empty file (clearly added by accident) 2024-09-19 20:02:09 +00:00
John Colvin de439579cf fix: Fix improper 'OfType' linq cast
Previously, animations were expressed through polymorphism (derived from the
base class CellAnimation), but the new impl uses composition. This 'OfType' call
was leftover from the polymorphism implementation, an attempt to linq cast
elements of base class (CellAnimation) to BackgroundAnimation.
2024-09-19 20:02:09 +00:00
John Colvin 13646a5a16 refactor: Add WebsocketClient class
Basically an ISubject (I/O) wrapper for IWebsocketConnectionGateway
2024-09-19 20:02:09 +00:00
John Colvin 9a1e51eacf refactor: Change WebsocketServerConfig.port to uint32
It should always be a number between 1-65535
2024-09-19 20:02:09 +00:00
John Colvin 9982bd2203 refactor: Rename WebsocketServerConfig proto pkg 'bts.websocket_core'
This matches the namespace used in spark_websocket csproj. Eventually,
I'd like to use conventional capitalization (TitleCase namespaces/types,
etc.), but let's shelf that until we have enough time/energy to do a
more comprehensive refactoring.
2024-09-19 20:02:09 +00:00
John Colvin e7d7352941 refactor: Remove nullability constraint in GetValueOrDefault 2024-09-19 20:02:09 +00:00
John Colvin d2efe037f9 refactor: Use events to avoid circular deps for ws sync/gateway 2024-09-19 20:02:09 +00:00
John Colvin 67e6147633 refactor: Let caller specify nullability of T in json parse fn 2024-09-19 20:02:09 +00:00
John Colvin 37e5003cf9 Merge remote-tracking branch 'origin/development.ps_linux' into development 2024-09-19 05:40:59 +00:00
John Colvin 07f3868ffc Add CBOE to spark admin webapp 2024-09-18 19:03:43 +00:00