Commit Graph
11975 Commits
Author SHA1 Message Date
John Colvin 25c42e388f refactor: Decouple ViewPublisher from IPubTableBroker impl 2024-10-30 19:31:08 +00:00
John Colvin 3187722159 Add PubSub service modules designed for Dependency Injection
* Get rid of JsonPropertyName attributes in PubSubConfig
  - The Dependency Injection framework (based around dotnet ApplicationBuilder)
    does not support this attribute, and maps property names verbatim to json fields.

* Change PubSubServer json fields to match cs class property names verbatim
2024-10-30 19:31:08 +00:00
John Colvin 352cb97818 refactor: Decouple RemoteQueryManager from IManagedSubscriber, IPubTableBroker impl 2024-10-30 19:30:30 +00:00
John Colvin 0215b7990e refactor: Decouple ManagedSubscriber from ISubscriberCore impl 2024-10-30 19:30:30 +00:00
John Colvin 1644b5b58b refactor: Only support 1 tag type in IPubSubServerTagHandler 2024-10-30 19:30:30 +00:00
John Colvin b2ea6820d7 refactor: Decouple PubTableBroker from IPublisherCore impl
Reference interface rather than the PublisherCore impl.
2024-10-30 19:30:30 +00:00
John Colvin 5c9fc5ccc2 improvement: Accept CancellationToken in JsonRpcRequestObservable 2024-10-30 19:30:30 +00:00
John Colvin 4bd6f149b9 fix: Dispose market data sub in various md streams 2024-10-30 19:30:30 +00:00
John Colvin 293f7f3833 cleanup: Remove unused pubsub tag handler code
* Removed 'IPubSubServerTagHandler.register'
  - All implementations of this function were empty
* Removed 'IPubSubServerTagHandler.supportedTagTypes'
  - This property wasn't referenced anywhere
* Remove IWorker inheritance from IPubSubServerTagHandler
  - No reason these interfaces have to be tied together
2024-10-30 19:30:30 +00:00
John Colvin ad2f9a8624 refactor: Rename CloudStreamManager.cs -> RemoteQueryManager.cs
This matches the file name
2024-10-30 19:30:30 +00:00
John Colvin 99922725e1 Change pub sub schema prefix 'bluto://' -> 'bts-cloud://'
In config json files (not actual code change)
2024-10-30 19:30:30 +00:00
John Colvin 60c3cc0015 fix build: Fix prop names after refactoring PubSubRoute
* Change 'server_address' -> 'ServerAddress'
* Change 'tag_reg_exp' -> 'TagRegExp'
2024-10-30 19:30:30 +00:00
John Colvin e1555387ec Fix typo in log msg 2024-10-30 19:30:30 +00:00
John Colvin 545dcdf9ff feat: Add DataStream WebApp
Included in DataStreamSuite.sln, but not DataStreamQueryAnalyzer.sln
2024-10-30 19:30:29 +00:00
John Colvin 8c2d643e0c Add spark service modules designed for Dependency Injection 2024-10-30 19:30:29 +00:00
John Colvin ae70f731b7 build: Copy libspark to all dotnet dirs in single cmake target
This is cleaner than the previous impl, which used separate build
targets to copy libspark to "net7.0", and "net7.0-windows" (dirs).
2024-10-30 19:30:29 +00:00
John Colvin 828b06d4e2 fix: Parse ServerAddress as normal string
The "JsonValueOrArrayConverter<T>" doesn't work the way I thought it
would. When it is associated with a property via the JsonConverter
attribute, dotnet json parsing code throws an exception if "T" isn't
assignable to the property type.
2024-10-30 19:30:29 +00:00
John Colvin 6fa8de176c fix build (api server): Change namespace to bts.websocket_core 2024-10-30 19:30:29 +00:00
John Colvin 06ad7c51be fix build (warn): Only use Registry on windows 2024-10-30 19:30:29 +00:00
John Colvin 60a52b3922 cleanup: Fix numerous build warnings in DataStreamSuite
Nearly all warnings were due to nullability issues, since the concept of
nullable reference types did not exist when the DataStream code was
originally written.

* PubSubClientMessage
  - Normalize indentation/whitespace
  - Fix some typos
  - Address nullability issues to fix build warnings
  - Modernize code

* Compression related files
  - ZipEntry
  - ZipFile
  - ZipInputStream
  - TarHeader

* RemoteMessage
  - make 'message' nullable to resolve warnings elsewhere (in calling code)

* PubSubSingleTagStateEvent.cs
* PubSubMessageReactor
* PubSubState
* SystemHeartbeatPublisher
* SystemStatsPublisher
* SingleTagData
* ManagedTCPMessageHub
* PubsubDeserializationController
* PublisherCore
* InflaterHuffmanTree
* AsyncTCPConnection_APM
* ThreadSafeQueue
* ManagedSubscriber
* SubscriberCore
* PubSubServerManagedTCPConnection
* AsyncTCPConnection_APM
* SuperMapStream
* MapStream
* TradeBarsStream
2024-10-30 19:30:29 +00:00
John Colvin 5426ba0aa7 cleanup: Disable nullability warnings
* BZip2InputStream
* TarInputStream
* Inflater
* InflaterDynHeader
* BZip2OutputStream
* DeflaterHuffman
* ParallelJoinTest
2024-10-30 19:24:18 +00:00
John Colvin b1fdee5a22 cleanup: Modernize PubSubRoute code, json parsing 2024-10-30 19:24:18 +00:00
John Colvin 59461aadff cleanup: Remove unused DateTime grammar from exp parser 2024-10-30 19:24:18 +00:00
John Colvin 2d3a9a77ae Add JsonRpcRequestObservable, AsyncEnumerable 2024-10-30 19:24:18 +00:00
John Colvin 868b43ef8b Add json facilities for DataStream websocket api 2024-10-30 19:24:18 +00:00
John Colvin fc7043f6e1 refactor: Add handy WebsocketExtensions
* IsSocketStateOpen
* IsClosedProperly
2024-10-30 19:24:18 +00:00
John Colvin 7bec823545 feat: Add JsonRpc types for websocket paradigm 2024-10-30 19:24:18 +00:00
John Colvin 57c7868a24 cleanup: Remove empty file (clearly added by accident) 2024-10-30 19:24:18 +00:00
John Colvin 0b0ff8f502 fix: Fix improper 'OfType' linq cast
Previously, animations were expressed through polymorphism (derived from the
base class CellAnimation), but the new impl uses composition. This 'OfType' call
was leftover from the polymorphism implementation, an attempt to linq cast
elements of base class (CellAnimation) to BackgroundAnimation.
2024-10-30 19:24:18 +00:00
John Colvin d7e4c68c70 refactor: Add WebsocketClient class
Basically an ISubject (I/O) wrapper for IWebsocketConnectionGateway
2024-10-30 19:24:18 +00:00
John Colvin 70f782bc79 refactor: Change WebsocketServerConfig.port to uint32
It should always be a number between 1-65535
2024-10-30 19:24:18 +00:00
John Colvin 7e142860a3 refactor: Rename WebsocketServerConfig proto pkg 'bts.websocket_core'
This matches the namespace used in spark_websocket csproj. Eventually,
I'd like to use conventional capitalization (TitleCase namespaces/types,
etc.), but let's shelf that until we have enough time/energy to do a
more comprehensive refactoring.
2024-10-30 19:24:18 +00:00
John Colvin 1956e3a804 refactor: Remove nullability constraint in GetValueOrDefault 2024-10-30 19:24:18 +00:00
John Colvin 65b50eda3a refactor: Use events to avoid circular deps for ws sync/gateway 2024-10-30 19:24:18 +00:00
Taha 83b37c6661 Merge branch 'development' of bitbucket.org:bluetradesys/spark into development 2024-10-30 13:36:33 -04:00
Taha 6163887cd3 Bunch of CME queries are now working 2024-10-30 13:36:23 -04:00
Mohammad Arham 214641aa1e Add: cpp tp sec_common 2024-10-25 07:02:46 +00:00
Mohammad Arham 06bc7af232 FIx: Taifex md working 2024-10-25 06:59:52 +00:00
Mohammad Arham 36b6168dec Taifex State working 2024-10-18 21:13:56 +00:00
Taha f9aa9dd982 Merge branch 'development' of bitbucket.org:bluetradesys/spark into development 2024-10-15 23:48:34 -04:00
Taha 22f1ab44f9 Basic set of streams that can talks ot the LLM and get DSL back from few-shot prompt 2024-10-15 23:38:49 -04:00
John Colvin e4c87c267d Fix DateTimeConstant token regex for DataStreams
The previous regex was overly ambitious (and needlessly complex as a
result). The new regex is simpler, and doesn't impose bounds on month
and day ints, aside from requiring 1-2 digits.

Bugs (fixed):
  * The DataStreamExpressionInterpretter fails to parse certain date
    constants, such as "8/30/2024"
2024-10-15 11:46:58 -04:00
Mohammad Arham 86899a6ff0 FIX: TAifex state working 2024-10-14 17:19:03 +00:00
Adeel Khan 2324fd3ad2 CHANGE: Taifex State Mgmt 2024-10-14 20:59:34 +05:00
Taha 288b7712db Added and modified more streams to address teh CME NL queries 2024-10-09 13:59:01 -04:00
Mohammad Arham 8850bf4903 Remove: Assert in taifex code 2024-10-09 14:53:20 +00:00
Mohammad Arham 11112b41d1 Add: Missing config entry databento 2024-10-09 02:36:35 +00:00
Adeel Khan 2a98889b67 UPDATE: TaifexDataGateway 2024-10-09 02:18:28 +00:00
Adeel Khan 8060518a28 FIX: Removed Taifex Bugs 2024-10-08 21:29:44 +00:00
Mohammad Arham 68440d3df3 ADD: Config for one year security filter 2024-10-08 13:50:38 +00:00