Commit Graph
213 Commits
Author SHA1 Message Date
John Colvin e4ed09d96e Hardcode webSocketUrl to aws server in DataStreamWebApp client 2024-10-14 17:21:46 +00:00
John Colvin 6edb8b89f0 Assert that System publishers 'doWork' is always called on same thread 2024-10-14 17:21:46 +00:00
John Colvin b870e49d01 fix: Make InternalPublisherQueue thread safe 2024-10-14 17:21:46 +00:00
John Colvin f2e5ed35fb Improve error reporting in DataStreamWebSocketServer 2024-10-14 17:21:45 +00:00
John Colvin 368ffce5cf data stream web app client check pt 2024-10-14 17:21:45 +00:00
John Colvin 979eb50268 pubsub server checkpt 2024-10-14 17:21:45 +00:00
John Colvin 3960403d5a pubsub checkpt 2024-10-14 17:21:45 +00:00
John Colvin ff66151fc1 datastreamwebapp server checkpt 2024-10-14 17:21:45 +00:00
John Colvin 76dcc331e4 datastream webapp client check pt 2024-10-14 17:21:45 +00:00
John Colvin 037ce4a2b8 fix add pubsub services 2024-10-14 17:21:45 +00:00
John Colvin 96f0cfec1c Remove unused PubSubConfig props 2024-10-14 17:21:45 +00:00
John Colvin 6d013abe7a Fix dsqa config json 2024-10-14 17:21:45 +00:00
John Colvin 97691cceb3 fix: Always call 'handle_internal_pubs' in PubSubMessageReactor main loop 2024-10-14 17:21:45 +00:00
John Colvin 7a612502e9 improvement: Accept CancellationToken, catch exceptions when running ds websocket server 2024-10-14 17:21:45 +00:00
John Colvin 964f9a0b06 Fix mismatched types in PubSubServerTagStatsStream schema 2024-10-14 17:21:45 +00:00
John Colvin 5085e872cb Add DataStreamPublisher service modules designed for Dependency Injection
* Change DataStreamPublisher json fields to match cs class property names verbatim
* Rename Publishers -> PublisherNodes in DataStreamPublisherConfig
2024-10-14 17:21:45 +00:00
John Colvin c0fd30ab92 refactor: Decouple ViewPublisher from IPubTableBroker impl 2024-10-14 17:21:45 +00:00
John Colvin 40dfbd90d5 Add PubSub service modules designed for Dependency Injection
* Get rid of JsonPropertyName attributes in PubSubConfig
  - The Dependency Injection framework (based around dotnet ApplicationBuilder)
    does not support this attribute, and maps property names verbatim to json fields.

* Change PubSubServer json fields to match cs class property names verbatim
2024-10-14 17:21:45 +00:00
John Colvin 9411e8ed21 refactor: Decouple RemoteQueryManager from IManagedSubscriber, IPubTableBroker impl 2024-10-14 17:21:45 +00:00
John Colvin b6291d89e3 refactor: Decouple ManagedSubscriber from ISubscriberCore impl 2024-10-14 17:21:45 +00:00
John Colvin 4fb8b26812 refactor: Only support 1 tag type in IPubSubServerTagHandler 2024-10-14 17:21:45 +00:00
John Colvin 583932ea91 refactor: Decouple PubTableBroker from IPublisherCore impl
Reference interface rather than the PublisherCore impl.
2024-10-14 17:21:45 +00:00
John Colvin 1d76c0c0ed fix: Dispose market data sub in various md streams 2024-10-14 17:21:45 +00:00
John Colvin 89cb2b04bf cleanup: Remove unused pubsub tag handler code
* Removed 'IPubSubServerTagHandler.register'
  - All implementations of this function were empty
* Removed 'IPubSubServerTagHandler.supportedTagTypes'
  - This property wasn't referenced anywhere
* Remove IWorker inheritance from IPubSubServerTagHandler
  - No reason these interfaces have to be tied together
2024-10-14 17:21:45 +00:00
John Colvin 55f7a86500 refactor: Rename CloudStreamManager.cs -> RemoteQueryManager.cs
This matches the file name
2024-10-14 17:21:45 +00:00
John Colvin 86d01e73c4 Change pub sub schema prefix 'bluto://' -> 'bts-cloud://'
In config json files (not actual code change)
2024-10-14 17:21:45 +00:00
John Colvin 142aca7dc5 fix build: Fix prop names after refactoring PubSubRoute
* Change 'server_address' -> 'ServerAddress'
* Change 'tag_reg_exp' -> 'TagRegExp'
2024-10-14 17:21:45 +00:00
John Colvin d6983ab359 Fix typo in log msg 2024-10-14 17:21:45 +00:00
John Colvin fac11fdfe2 feat: Add DataStream WebApp
Included in DataStreamSuite.sln, but not DataStreamQueryAnalyzer.sln
2024-10-14 17:21:45 +00:00
John Colvin 4d2cac7216 fix: Parse ServerAddress as normal string
The "JsonValueOrArrayConverter<T>" doesn't work the way I thought it
would. When it is associated with a property via the JsonConverter
attribute, dotnet json parsing code throws an exception if "T" isn't
assignable to the property type.
2024-10-14 17:21:45 +00:00
John Colvin 9469906d4d fix build (warn): Only use Registry on windows 2024-10-14 17:21:45 +00:00
John Colvin de62ac6e82 cleanup: Fix numerous build warnings in DataStreamSuite
Nearly all warnings were due to nullability issues, since the concept of
nullable reference types did not exist when the DataStream code was
originally written.

* PubSubClientMessage
  - Normalize indentation/whitespace
  - Fix some typos
  - Address nullability issues to fix build warnings
  - Modernize code

* Compression related files
  - ZipEntry
  - ZipFile
  - ZipInputStream
  - TarHeader

* RemoteMessage
  - make 'message' nullable to resolve warnings elsewhere (in calling code)

* PubSubSingleTagStateEvent.cs
* PubSubMessageReactor
* PubSubState
* SystemHeartbeatPublisher
* SystemStatsPublisher
* SingleTagData
* ManagedTCPMessageHub
* PubsubDeserializationController
* PublisherCore
* InflaterHuffmanTree
* AsyncTCPConnection_APM
* ThreadSafeQueue
* ManagedSubscriber
* SubscriberCore
* PubSubServerManagedTCPConnection
* AsyncTCPConnection_APM
* SuperMapStream
* MapStream
* TradeBarsStream
2024-10-14 17:21:45 +00:00
John Colvin 4340910285 cleanup: Normalize indentation in TradeBarsStream 2024-10-14 17:21:45 +00:00
John Colvin 3b5e8d6e7e cleanup: Disable nullability warnings
* BZip2InputStream
* TarInputStream
* Inflater
* InflaterDynHeader
* BZip2OutputStream
* DeflaterHuffman
* ParallelJoinTest
2024-10-14 17:21:45 +00:00
John Colvin 2fab790ebf cleanup: Modernize PubSubRoute code, json parsing 2024-10-14 17:21:45 +00:00
John Colvin 06352bd6e9 cleanup: Remove unused DateTime grammar from exp parser 2024-10-14 17:21:45 +00:00
John Colvin f7c2fc52ce Add json facilities for DataStream websocket api 2024-10-14 17:21:45 +00:00
John Colvin 48419e8d3c cleanup: Remove empty file (clearly added by accident) 2024-10-14 17:21:45 +00:00
John Colvin 37e5003cf9 Merge remote-tracking branch 'origin/development.ps_linux' into development 2024-09-19 05:40:59 +00:00
Taha 322c06bfbe Fixing build relted to BCG vs bts namespace 2024-08-21 16:24:22 -04:00
Taha b68fceb362 Cleaning up FileStreams 2024-08-21 16:11:57 -04:00
Taha 31df1a3827 Added benzinga streamd to MDPub's test config 2024-07-17 14:32:57 -04:00
Taha 7e219aec7c Merging 2024-07-17 02:06:17 -04:00
Taha 37f8b98df9 Icomplete SharedStreamsConfig was breaking build, fixing 2024-07-17 02:03:43 -04:00
Taha f06beff22f Added new benzinga streams 2024-07-17 02:02:01 -04:00
Taha Afzal 6aa39a716a PubSubSingleTagState is not needed any more 2024-07-16 01:15:51 +00:00
Taha Afzal 5088b5ebe0 Fixing problems where PSS's client socket's IP was different than what the client was sending in PubSubClientSubscription 2024-07-08 23:09:53 +00:00
Taha Afzal 010dd3a26f Fixing PubsubEchoTestStream 2024-07-07 06:13:22 +00:00
Taha Afzal 1a18755176 Added pss_echo() 2024-07-06 06:53:35 +00:00
Taha Afzal 233e2576af Merging 2024-07-05 21:21:27 +00:00