Commit Graph
13497 Commits
Author SHA1 Message Date
John Colvin 97691cceb3 fix: Always call 'handle_internal_pubs' in PubSubMessageReactor main loop 2024-10-14 17:21:45 +00:00
John Colvin 7a612502e9 improvement: Accept CancellationToken, catch exceptions when running ds websocket server 2024-10-14 17:21:45 +00:00
John Colvin 964f9a0b06 Fix mismatched types in PubSubServerTagStatsStream schema 2024-10-14 17:21:45 +00:00
John Colvin 5085e872cb Add DataStreamPublisher service modules designed for Dependency Injection
* Change DataStreamPublisher json fields to match cs class property names verbatim
* Rename Publishers -> PublisherNodes in DataStreamPublisherConfig
2024-10-14 17:21:45 +00:00
John Colvin c0fd30ab92 refactor: Decouple ViewPublisher from IPubTableBroker impl 2024-10-14 17:21:45 +00:00
John Colvin 40dfbd90d5 Add PubSub service modules designed for Dependency Injection
* Get rid of JsonPropertyName attributes in PubSubConfig
  - The Dependency Injection framework (based around dotnet ApplicationBuilder)
    does not support this attribute, and maps property names verbatim to json fields.

* Change PubSubServer json fields to match cs class property names verbatim
2024-10-14 17:21:45 +00:00
John Colvin 9411e8ed21 refactor: Decouple RemoteQueryManager from IManagedSubscriber, IPubTableBroker impl 2024-10-14 17:21:45 +00:00
John Colvin b6291d89e3 refactor: Decouple ManagedSubscriber from ISubscriberCore impl 2024-10-14 17:21:45 +00:00
John Colvin 4fb8b26812 refactor: Only support 1 tag type in IPubSubServerTagHandler 2024-10-14 17:21:45 +00:00
John Colvin 583932ea91 refactor: Decouple PubTableBroker from IPublisherCore impl
Reference interface rather than the PublisherCore impl.
2024-10-14 17:21:45 +00:00
John Colvin 8f0a758f1a improvement: Accept CancellationToken in JsonRpcRequestObservable 2024-10-14 17:21:45 +00:00
John Colvin 1d76c0c0ed fix: Dispose market data sub in various md streams 2024-10-14 17:21:45 +00:00
John Colvin 89cb2b04bf cleanup: Remove unused pubsub tag handler code
* Removed 'IPubSubServerTagHandler.register'
  - All implementations of this function were empty
* Removed 'IPubSubServerTagHandler.supportedTagTypes'
  - This property wasn't referenced anywhere
* Remove IWorker inheritance from IPubSubServerTagHandler
  - No reason these interfaces have to be tied together
2024-10-14 17:21:45 +00:00
John Colvin 55f7a86500 refactor: Rename CloudStreamManager.cs -> RemoteQueryManager.cs
This matches the file name
2024-10-14 17:21:45 +00:00
John Colvin 86d01e73c4 Change pub sub schema prefix 'bluto://' -> 'bts-cloud://'
In config json files (not actual code change)
2024-10-14 17:21:45 +00:00
John Colvin 142aca7dc5 fix build: Fix prop names after refactoring PubSubRoute
* Change 'server_address' -> 'ServerAddress'
* Change 'tag_reg_exp' -> 'TagRegExp'
2024-10-14 17:21:45 +00:00
John Colvin 7b57a07a31 build: Add scripts to publish data stream apps 2024-10-14 17:21:45 +00:00
John Colvin d6983ab359 Fix typo in log msg 2024-10-14 17:21:45 +00:00
John Colvin dfa47bd88e Fix build scripts so they propagate the exit code back to the shell
I noticed this was broken because launch.json configurations would still start the debugger
even when the preLaunchTask (build) failed!
2024-10-14 17:21:45 +00:00
John Colvin 9fcf23c0d7 vscode: Add DataStreamPublisher debug cfg to skip build 2024-10-14 17:21:45 +00:00
John Colvin 5a51d6e7f6 build: Use separate cmd to build DataStreamSuite/QueryAnalyzer.sln
The DataStreamSuite.sln builds the new webapp now, which will
(eventually) replace DSQA. We'll keep it around for now, but with a
clean separation from the main build.
2024-10-14 17:21:45 +00:00
John Colvin fac11fdfe2 feat: Add DataStream WebApp
Included in DataStreamSuite.sln, but not DataStreamQueryAnalyzer.sln
2024-10-14 17:21:45 +00:00
John Colvin 4932388338 Add spark service modules designed for Dependency Injection 2024-10-14 17:21:45 +00:00
John Colvin cccfbc7bd2 build: Copy libspark to all dotnet dirs in single cmake target
This is cleaner than the previous impl, which used separate build
targets to copy libspark to "net7.0", and "net7.0-windows" (dirs).
2024-10-14 17:21:45 +00:00
John Colvin 4d2cac7216 fix: Parse ServerAddress as normal string
The "JsonValueOrArrayConverter<T>" doesn't work the way I thought it
would. When it is associated with a property via the JsonConverter
attribute, dotnet json parsing code throws an exception if "T" isn't
assignable to the property type.
2024-10-14 17:21:45 +00:00
John Colvin 1c30546c24 fix build (api server): Change namespace to bts.websocket_core 2024-10-14 17:21:45 +00:00
John Colvin c79ee0217a Remove docker submodules again 2024-10-14 17:21:45 +00:00
John Colvin a8b8e4215e Change externals url from ssh to https style
So we don't need ssh keys to clone it (the builtin credential manager
makes https authentication safe/easy)
2024-10-14 17:21:45 +00:00
John Colvin 79f3431e77 cleanup: Fix benign typos in build scripts
Change BUILD_SPARK_PY var name to BUILD_PY (because these scripts to actually build 'spark')
2024-10-14 17:21:45 +00:00
John Colvin 9469906d4d fix build (warn): Only use Registry on windows 2024-10-14 17:21:45 +00:00
John Colvin de62ac6e82 cleanup: Fix numerous build warnings in DataStreamSuite
Nearly all warnings were due to nullability issues, since the concept of
nullable reference types did not exist when the DataStream code was
originally written.

* PubSubClientMessage
  - Normalize indentation/whitespace
  - Fix some typos
  - Address nullability issues to fix build warnings
  - Modernize code

* Compression related files
  - ZipEntry
  - ZipFile
  - ZipInputStream
  - TarHeader

* RemoteMessage
  - make 'message' nullable to resolve warnings elsewhere (in calling code)

* PubSubSingleTagStateEvent.cs
* PubSubMessageReactor
* PubSubState
* SystemHeartbeatPublisher
* SystemStatsPublisher
* SingleTagData
* ManagedTCPMessageHub
* PubsubDeserializationController
* PublisherCore
* InflaterHuffmanTree
* AsyncTCPConnection_APM
* ThreadSafeQueue
* ManagedSubscriber
* SubscriberCore
* PubSubServerManagedTCPConnection
* AsyncTCPConnection_APM
* SuperMapStream
* MapStream
* TradeBarsStream
2024-10-14 17:21:45 +00:00
John Colvin 4340910285 cleanup: Normalize indentation in TradeBarsStream 2024-10-14 17:21:45 +00:00
John Colvin 3b5e8d6e7e cleanup: Disable nullability warnings
* BZip2InputStream
* TarInputStream
* Inflater
* InflaterDynHeader
* BZip2OutputStream
* DeflaterHuffman
* ParallelJoinTest
2024-10-14 17:21:45 +00:00
John Colvin 2fab790ebf cleanup: Modernize PubSubRoute code, json parsing 2024-10-14 17:21:45 +00:00
John Colvin 06352bd6e9 cleanup: Remove unused DateTime grammar from exp parser 2024-10-14 17:21:45 +00:00
John Colvin ea4c91116f Add JsonRpcRequestObservable, AsyncEnumerable 2024-10-14 17:21:45 +00:00
John Colvin f7c2fc52ce Add json facilities for DataStream websocket api 2024-10-14 17:21:45 +00:00
John Colvin 7882c5ca77 refactor: Add handy WebsocketExtensions
* IsSocketStateOpen
* IsClosedProperly
2024-10-14 17:21:45 +00:00
John Colvin 91b9d2a37b feat: Add JsonRpc types for websocket paradigm 2024-10-14 17:21:45 +00:00
John Colvin 48419e8d3c cleanup: Remove empty file (clearly added by accident) 2024-10-14 17:21:45 +00:00
John Colvin 66511d69bb fix: Fix improper 'OfType' linq cast
Previously, animations were expressed through polymorphism (derived from the
base class CellAnimation), but the new impl uses composition. This 'OfType' call
was leftover from the polymorphism implementation, an attempt to linq cast
elements of base class (CellAnimation) to BackgroundAnimation.
2024-10-14 17:21:45 +00:00
John Colvin 68a6e716f7 editorconfig: Use standard c# capitalization rules
* Use 'PascalCase' for public members (instead of 'snake_case')
* Use 'camelCase' for private members (instead of '_snake_case')
2024-10-14 17:21:45 +00:00
John Colvin 5d28d0e455 refactor: Add WebsocketClient class
Basically an ISubject (I/O) wrapper for IWebsocketConnectionGateway
2024-10-14 17:21:45 +00:00
John Colvin 8db44cc7f5 refactor: Change WebsocketServerConfig.port to uint32
It should always be a number between 1-65535
2024-10-14 17:21:45 +00:00
John Colvin 91220a0296 refactor: Rename WebsocketServerConfig proto pkg 'bts.websocket_core'
This matches the namespace used in spark_websocket csproj. Eventually,
I'd like to use conventional capitalization (TitleCase namespaces/types,
etc.), but let's shelf that until we have enough time/energy to do a
more comprehensive refactoring.
2024-10-14 17:21:45 +00:00
John Colvin 9709112307 refactor: Remove nullability constraint in GetValueOrDefault 2024-10-14 17:21:44 +00:00
John Colvin 82128be9ca refactor: Use events to avoid circular deps for ws sync/gateway 2024-10-14 17:21:44 +00:00
John Colvin fd59682b28 refactor: Let caller specify nullability of T in json parse fn 2024-10-14 17:21:44 +00:00
Adeel Khan 2324fd3ad2 CHANGE: Taifex State Mgmt 2024-10-14 20:59:34 +05:00
Mohammad Arham 8850bf4903 Remove: Assert in taifex code 2024-10-09 14:53:20 +00:00