Commit Graph
13541 Commits
Author SHA1 Message Date
John Colvin e4745a587f Fix mismatched types in PubSubServerTagStatsStream schema 2024-11-29 14:57:43 +00:00
John Colvin adfc0b5235 Add DataStreamPublisher service modules designed for Dependency Injection
* Change DataStreamPublisher json fields to match cs class property names verbatim
* Rename Publishers -> PublisherNodes in DataStreamPublisherConfig
2024-11-29 14:57:43 +00:00
John Colvin 30cf7ac5f9 refactor: Decouple ViewPublisher from IPubTableBroker impl 2024-11-29 14:57:43 +00:00
John Colvin 31b065c854 Add PubSub service modules designed for Dependency Injection
* Get rid of JsonPropertyName attributes in PubSubConfig
  - The Dependency Injection framework (based around dotnet ApplicationBuilder)
    does not support this attribute, and maps property names verbatim to json fields.

* Change PubSubServer json fields to match cs class property names verbatim
2024-11-29 14:57:43 +00:00
John Colvin 04a0cf9144 refactor: Decouple RemoteQueryManager from IManagedSubscriber, IPubTableBroker impl 2024-11-29 14:57:43 +00:00
John Colvin 37d6ffa27a refactor: Decouple ManagedSubscriber from ISubscriberCore impl 2024-11-29 14:57:43 +00:00
John Colvin 2760867093 refactor: Only support 1 tag type in IPubSubServerTagHandler 2024-11-29 14:57:43 +00:00
John Colvin 191de2ae46 refactor: Decouple PubTableBroker from IPublisherCore impl
Reference interface rather than the PublisherCore impl.
2024-11-29 14:57:43 +00:00
John Colvin 0b444d5f2f improvement: Accept CancellationToken in JsonRpcRequestObservable 2024-11-29 14:57:43 +00:00
John Colvin 702eac44d3 fix: Dispose market data sub in various md streams 2024-11-29 14:57:43 +00:00
John Colvin 30b23d36fa cleanup: Remove unused pubsub tag handler code
* Removed 'IPubSubServerTagHandler.register'
  - All implementations of this function were empty
* Removed 'IPubSubServerTagHandler.supportedTagTypes'
  - This property wasn't referenced anywhere
* Remove IWorker inheritance from IPubSubServerTagHandler
  - No reason these interfaces have to be tied together
2024-11-29 14:57:43 +00:00
John Colvin 202a9f6206 refactor: Rename CloudStreamManager.cs -> RemoteQueryManager.cs
This matches the file name
2024-11-29 14:57:43 +00:00
John Colvin 0d1966e752 Change pub sub schema prefix 'bluto://' -> 'bts-cloud://'
In config json files (not actual code change)
2024-11-29 14:57:43 +00:00
John Colvin a25905d55d fix build: Fix prop names after refactoring PubSubRoute
* Change 'server_address' -> 'ServerAddress'
* Change 'tag_reg_exp' -> 'TagRegExp'
2024-11-29 14:57:43 +00:00
John Colvin dddf14e356 build: Add scripts to publish data stream apps 2024-11-29 14:57:42 +00:00
John Colvin 962fd8712a Fix typo in log msg 2024-11-29 14:57:13 +00:00
John Colvin 7685b1f628 Fix build scripts so they propagate the exit code back to the shell
I noticed this was broken because launch.json configurations would still start the debugger
even when the preLaunchTask (build) failed!
2024-11-29 14:57:13 +00:00
John Colvin ef94ecf6a6 vscode: Add DataStreamPublisher debug cfg to skip build 2024-11-29 14:57:13 +00:00
John Colvin 26f9a76fc8 build: Use separate cmd to build DataStreamSuite/QueryAnalyzer.sln
The DataStreamSuite.sln builds the new webapp now, which will
(eventually) replace DSQA. We'll keep it around for now, but with a
clean separation from the main build.
2024-11-29 14:57:13 +00:00
John Colvin 806c204f08 feat: Add DataStream WebApp
Included in DataStreamSuite.sln, but not DataStreamQueryAnalyzer.sln
2024-11-29 14:57:13 +00:00
John Colvin 4aa3c67e87 Add spark service modules designed for Dependency Injection 2024-11-29 14:57:13 +00:00
John Colvin 614adac241 build: Copy libspark to all dotnet dirs in single cmake target
This is cleaner than the previous impl, which used separate build
targets to copy libspark to "net7.0", and "net7.0-windows" (dirs).
2024-11-29 14:57:13 +00:00
John Colvin 63ece377de fix: Parse ServerAddress as normal string
The "JsonValueOrArrayConverter<T>" doesn't work the way I thought it
would. When it is associated with a property via the JsonConverter
attribute, dotnet json parsing code throws an exception if "T" isn't
assignable to the property type.
2024-11-29 14:57:13 +00:00
John Colvin e49efc2bbf fix build (api server): Change namespace to bts.websocket_core 2024-11-29 14:57:13 +00:00
John Colvin e431c309ed Remove docker submodules again 2024-11-29 14:57:13 +00:00
John Colvin 3c5769b3da Change externals url from ssh to https style
So we don't need ssh keys to clone it (the builtin credential manager
makes https authentication safe/easy)
2024-11-29 14:57:13 +00:00
John Colvin efe09eb1b7 cleanup: Fix benign typos in build scripts
Change BUILD_SPARK_PY var name to BUILD_PY (because these scripts to actually build 'spark')
2024-11-29 14:57:13 +00:00
John Colvin ca0cc90a24 fix build (warn): Only use Registry on windows 2024-11-29 14:57:13 +00:00
John Colvin ce2c3d930a cleanup: Fix numerous build warnings in DataStreamSuite
Nearly all warnings were due to nullability issues, since the concept of
nullable reference types did not exist when the DataStream code was
originally written.

* PubSubClientMessage
  - Normalize indentation/whitespace
  - Fix some typos
  - Address nullability issues to fix build warnings
  - Modernize code

* Compression related files
  - ZipEntry
  - ZipFile
  - ZipInputStream
  - TarHeader

* RemoteMessage
  - make 'message' nullable to resolve warnings elsewhere (in calling code)

* PubSubSingleTagStateEvent.cs
* PubSubMessageReactor
* PubSubState
* SystemHeartbeatPublisher
* SystemStatsPublisher
* SingleTagData
* ManagedTCPMessageHub
* PubsubDeserializationController
* PublisherCore
* InflaterHuffmanTree
* AsyncTCPConnection_APM
* ThreadSafeQueue
* ManagedSubscriber
* SubscriberCore
* PubSubServerManagedTCPConnection
* AsyncTCPConnection_APM
* SuperMapStream
* MapStream
* TradeBarsStream
2024-11-29 14:57:13 +00:00
John Colvin e7725233e4 cleanup: Disable nullability warnings
* BZip2InputStream
* TarInputStream
* Inflater
* InflaterDynHeader
* BZip2OutputStream
* DeflaterHuffman
* ParallelJoinTest
2024-11-29 14:57:13 +00:00
John Colvin 6ed6b65027 cleanup: Modernize PubSubRoute code, json parsing 2024-11-29 14:57:13 +00:00
John Colvin 899e57cfef cleanup: Remove unused DateTime grammar from exp parser 2024-11-29 14:57:13 +00:00
John Colvin 2fae6f6312 Add JsonRpcRequestObservable, AsyncEnumerable 2024-11-29 14:57:13 +00:00
John Colvin 030f1adaed Add json facilities for DataStream websocket api 2024-11-29 14:57:13 +00:00
John Colvin 1ce7912b8c refactor: Add handy WebsocketExtensions
* IsSocketStateOpen
* IsClosedProperly
2024-11-29 14:57:13 +00:00
John Colvin 3f73b811db feat: Add JsonRpc types for websocket paradigm 2024-11-29 14:57:13 +00:00
John Colvin fee48eab80 cleanup: Remove empty file (clearly added by accident) 2024-11-29 14:57:13 +00:00
John Colvin ac6dde22f4 fix: Fix improper 'OfType' linq cast
Previously, animations were expressed through polymorphism (derived from the
base class CellAnimation), but the new impl uses composition. This 'OfType' call
was leftover from the polymorphism implementation, an attempt to linq cast
elements of base class (CellAnimation) to BackgroundAnimation.
2024-11-29 14:57:13 +00:00
John Colvin 83c1498e75 editorconfig: Use standard c# capitalization rules
* Use 'PascalCase' for public members (instead of 'snake_case')
* Use 'camelCase' for private members (instead of '_snake_case')
2024-11-29 14:57:13 +00:00
John Colvin 3a04775a4d refactor: Add WebsocketClient class
Basically an ISubject (I/O) wrapper for IWebsocketConnectionGateway
2024-11-29 14:57:12 +00:00
John Colvin b68daf48c8 refactor: Change WebsocketServerConfig.port to uint32
It should always be a number between 1-65535
2024-11-29 14:57:12 +00:00
John Colvin efcf4f66a1 refactor: Rename WebsocketServerConfig proto pkg 'bts.websocket_core'
This matches the namespace used in spark_websocket csproj. Eventually,
I'd like to use conventional capitalization (TitleCase namespaces/types,
etc.), but let's shelf that until we have enough time/energy to do a
more comprehensive refactoring.
2024-11-29 14:57:12 +00:00
John Colvin 39002b0829 refactor: Remove nullability constraint in GetValueOrDefault 2024-11-29 14:57:12 +00:00
John Colvin 71803ddcd6 refactor: Use events to avoid circular deps for ws sync/gateway 2024-11-29 14:57:12 +00:00
John Colvin 8cde8ee6e1 build: Add script to publish the api server
This will build the app as a self-contained executable here:
build/Release/bin/net7.0/linux-x64/publish
2024-11-28 16:35:21 +00:00
John Colvin 4f8fad444e fix build: Add missing csproj deps to Spark.Api.Server.sln 2024-11-28 16:35:20 +00:00
John Colvin 832c645a30 build: Map cmake install dir to associated preset
Cpp bins are now installed to "install/<cmake_preset>/bin". For example,
"install/sparkd-release-gcc/bin", "install/spark-api-server-linux/bin", etc.
2024-11-28 16:35:20 +00:00
John Colvin 691343d9b6 feat: Add datastreams to spark api server 2024-11-28 06:14:00 +00:00
Taha 461cbad338 Adding FakeBBO stream 2024-11-27 13:36:14 -05:00
Taha fecbcbb6b6 Merge branch 'development' of bitbucket.org:bluetradesys/spark into development 2024-11-26 22:33:31 -05:00