Commit Graph
12667 Commits
Author SHA1 Message Date
John Colvin debaaa0d04 Improve error reporting in DataStreamWebSocketServer 2025-07-23 15:59:52 -04:00
John Colvin 43735ed42e data stream web app client check pt 2025-07-23 15:59:43 -04:00
John Colvin 44b214ec55 fix build: Fix Spark build after making config init async 2025-07-23 15:58:33 -04:00
John Colvin 4188b8c00d refactor: Tweak SparkCoreServices to synchronize Configuration.init globally 2025-07-23 15:55:46 -04:00
John Colvin 44214aa195 refactor: Change Configuration.initialize to be async 2025-07-23 15:54:41 -04:00
John Colvin 856fb6410b SparkApiService check pt 2025-07-23 15:53:22 -04:00
John Colvin ed8420f346 datastreamwebapp server checkpt 2025-07-23 15:53:06 -04:00
John Colvin ca90b5dc43 datastream webapp client check pt 2025-07-23 15:52:40 -04:00
John Colvin 04829b1226 Remove unused PubSubConfig props 2025-07-23 15:52:09 -04:00
John Colvin d725fe4ba1 Fix dsqa config json 2025-07-23 15:51:30 -04:00
John Colvin fc8a39745d fix: Always call 'handle_internal_pubs' in PubSubMessageReactor main loop 2025-07-23 15:49:41 -04:00
John Colvin 476dd44838 improvement: Accept CancellationToken, catch exceptions when running ds websocket server 2025-07-23 15:48:25 -04:00
John Colvin 92d301831c Fix mismatched types in PubSubServerTagStatsStream schema 2025-07-23 15:48:09 -04:00
John Colvin c47ddf041f Add DataStreamPublisher service modules designed for Dependency Injection
* Change DataStreamPublisher json fields to match cs class property names verbatim
* Rename Publishers -> PublisherNodes in DataStreamPublisherConfig
2025-07-23 15:47:51 -04:00
John Colvin 2b7fa477fb refactor: Decouple ViewPublisher from IPubTableBroker impl 2025-07-23 15:47:39 -04:00
John Colvin 850d6a1ce4 Add PubSub service modules designed for Dependency Injection
* Get rid of JsonPropertyName attributes in PubSubConfig
  - The Dependency Injection framework (based around dotnet ApplicationBuilder)
    does not support this attribute, and maps property names verbatim to json fields.

* Change PubSubServer json fields to match cs class property names verbatim
2025-07-23 15:45:01 -04:00
John Colvin 0c3f063727 refactor: Decouple RemoteQueryManager from IManagedSubscriber, IPubTableBroker impl 2025-07-23 15:42:41 -04:00
John Colvin 742001fbb8 refactor: Decouple ManagedSubscriber from ISubscriberCore impl 2025-07-23 15:42:20 -04:00
John Colvin 3abb05ca7a refactor: Only support 1 tag type in IPubSubServerTagHandler 2025-07-23 15:41:56 -04:00
John Colvin 6f56471b91 refactor: Decouple PubTableBroker from IPublisherCore impl
Reference interface rather than the PublisherCore impl.
2025-07-23 15:41:41 -04:00
John Colvin 19a3541546 improvement: Accept CancellationToken in JsonRpcRequestObservable 2025-07-23 15:41:27 -04:00
John Colvin ef64417d27 fix: Dispose market data sub in various md streams 2025-07-23 15:41:05 -04:00
John Colvin 988139d549 cleanup: Remove unused pubsub tag handler code
* Removed 'IPubSubServerTagHandler.register'
  - All implementations of this function were empty
* Removed 'IPubSubServerTagHandler.supportedTagTypes'
  - This property wasn't referenced anywhere
* Remove IWorker inheritance from IPubSubServerTagHandler
  - No reason these interfaces have to be tied together
2025-07-23 15:36:48 -04:00
John Colvin 14edcc00f3 refactor: Rename CloudStreamManager.cs -> RemoteQueryManager.cs
This matches the file name
2025-07-23 15:36:29 -04:00
John Colvin 25ecaca6f1 Change pub sub schema prefix 'bluto://' -> 'bts-cloud://'
In config json files (not actual code change)
2025-07-23 15:36:11 -04:00
John Colvin a0b9a9b2cf fix build: Fix prop names after refactoring PubSubRoute
* Change 'server_address' -> 'ServerAddress'
* Change 'tag_reg_exp' -> 'TagRegExp'
2025-07-23 15:33:49 -04:00
John Colvin 5e856dd974 Fix typo in log msg 2025-07-23 15:30:52 -04:00
John Colvin 7d6d63365e feat: Add DataStream WebApp
Included in DataStreamSuite.sln, but not DataStreamQueryAnalyzer.sln
2025-07-23 15:21:58 -04:00
John Colvin ddf9bc7c0b Add spark service modules designed for Dependency Injection 2025-07-23 15:14:34 -04:00
John Colvin 15738f65e7 fix build (warn): Only use Registry on windows 2025-07-23 13:23:10 -04:00
John Colvin f2aaf524cb cleanup: Fix numerous build warnings in DataStreamSuite
Nearly all warnings were due to nullability issues, since the concept of
nullable reference types did not exist when the DataStream code was
originally written.

* PubSubClientMessage
  - Normalize indentation/whitespace
  - Fix some typos
  - Address nullability issues to fix build warnings
  - Modernize code

* Compression related files
  - ZipEntry
  - ZipFile
  - ZipInputStream
  - TarHeader

* RemoteMessage
  - make 'message' nullable to resolve warnings elsewhere (in calling code)

* PubSubSingleTagStateEvent.cs
* PubSubMessageReactor
* PubSubState
* SystemHeartbeatPublisher
* SystemStatsPublisher
* SingleTagData
* ManagedTCPMessageHub
* PubsubDeserializationController
* PublisherCore
* InflaterHuffmanTree
* AsyncTCPConnection_APM
* ThreadSafeQueue
* ManagedSubscriber
* SubscriberCore
* PubSubServerManagedTCPConnection
* AsyncTCPConnection_APM
* SuperMapStream
* MapStream
* TradeBarsStream
2025-07-23 13:22:48 -04:00
John Colvin f43f0d3950 cleanup: Disable nullability warnings
* BZip2InputStream
* TarInputStream
* Inflater
* InflaterDynHeader
* BZip2OutputStream
* DeflaterHuffman
* ParallelJoinTest
2025-07-23 13:16:22 -04:00
John Colvin f48e403a1f cleanup: Modernize PubSubRoute code, json parsing 2025-07-23 13:15:32 -04:00
John Colvin 22bfbd8ddb cleanup: Remove unused DateTime grammar from exp parser 2025-07-23 13:15:13 -04:00
John Colvin 44349f3f53 Add JsonRpcRequestObservable, AsyncEnumerable 2025-07-23 13:14:43 -04:00
John Colvin f79d897f62 Add json facilities for DataStream websocket api 2025-07-23 13:14:18 -04:00
John Colvin df7672832a refactor: Add handy WebsocketExtensions
* IsSocketStateOpen
* IsClosedProperly
2025-07-23 13:13:57 -04:00
John Colvin b3f23c1210 feat: Add JsonRpc types for websocket paradigm 2025-07-23 13:13:38 -04:00
John Colvin 353449f3d8 cleanup: Remove empty file (clearly added by accident) 2025-07-23 13:13:19 -04:00
John Colvin eecc70f151 Add generic ViewStream, BlueRow types/interfaces 2025-07-23 12:52:23 -04:00
John Colvin b121849189 Add BlueRowColumnMask to hide columns w/ minimal overhead
Less overhead than ProjectStream
2025-07-23 10:55:31 -04:00
John Colvin bbc07ce5fe fix: Remove query from literal error stream
The parser can't handle colons in the expression (it throws/crashes)
2025-07-23 10:55:31 -04:00
John Colvin 186ebb5309 Add async SQLiteEnumerator to read sqlite tables as IBlueRowCollection 2025-07-23 10:55:31 -04:00
John Colvin 9f35bb80ac Generate a few row types with new t4 templates 2025-07-23 10:55:31 -04:00
John Colvin ad8f283f8d build: Generate c# code for RowTypes
Produces structs that implement IBlueRow with strongly typed
properties for each column.
2025-07-23 10:55:31 -04:00
John Colvin e7dc5ace52 Add gen purpose blue row/table utils for data streams
* Add BlueRowReflection<T> so ViewStream implementations can use
  strong row types without needing to implement IBlueRow
* Add default implementations for IDictionary members in IBlueRow to make
  implementing IBlueRow less tedious
2025-07-23 10:55:30 -04:00
John Colvin 54a57fe6fe chore: Add CircularBuffer class (c#) 2025-07-23 10:00:22 -04:00
John Colvin 3b460f436a refactor: Rename ExceptionAssert.is_valid ExceptionAssert.Index.IsValid
Like the ExceptionAssert.Argument class that provides methods that throw
ArgumentException if a condition isn't satisfied, the ExceptionAssert.Index
class provides methods that throw IndexOutOfRange exceptions.
2025-07-23 09:59:36 -04:00
John Colvin 348f33c9af chore: Add OffsetList class
This supports mutations (unlike the SubRangeWrapper class).
2025-07-22 13:25:50 -04:00
John Colvin 33b95f418b cleanup: Remove "partial" class modifier for OrderBookVM
It simply wasn't necessary.
2025-07-22 01:36:51 -04:00