John Colvin
97691cceb3
fix: Always call 'handle_internal_pubs' in PubSubMessageReactor main loop
2024-10-14 17:21:45 +00:00
John Colvin
7a612502e9
improvement: Accept CancellationToken, catch exceptions when running ds websocket server
2024-10-14 17:21:45 +00:00
John Colvin
964f9a0b06
Fix mismatched types in PubSubServerTagStatsStream schema
2024-10-14 17:21:45 +00:00
John Colvin
5085e872cb
Add DataStreamPublisher service modules designed for Dependency Injection
...
* Change DataStreamPublisher json fields to match cs class property names verbatim
* Rename Publishers -> PublisherNodes in DataStreamPublisherConfig
2024-10-14 17:21:45 +00:00
John Colvin
c0fd30ab92
refactor: Decouple ViewPublisher from IPubTableBroker impl
2024-10-14 17:21:45 +00:00
John Colvin
40dfbd90d5
Add PubSub service modules designed for Dependency Injection
...
* Get rid of JsonPropertyName attributes in PubSubConfig
- The Dependency Injection framework (based around dotnet ApplicationBuilder)
does not support this attribute, and maps property names verbatim to json fields.
* Change PubSubServer json fields to match cs class property names verbatim
2024-10-14 17:21:45 +00:00
John Colvin
9411e8ed21
refactor: Decouple RemoteQueryManager from IManagedSubscriber, IPubTableBroker impl
2024-10-14 17:21:45 +00:00
John Colvin
b6291d89e3
refactor: Decouple ManagedSubscriber from ISubscriberCore impl
2024-10-14 17:21:45 +00:00
John Colvin
4fb8b26812
refactor: Only support 1 tag type in IPubSubServerTagHandler
2024-10-14 17:21:45 +00:00
John Colvin
583932ea91
refactor: Decouple PubTableBroker from IPublisherCore impl
...
Reference interface rather than the PublisherCore impl.
2024-10-14 17:21:45 +00:00
John Colvin
8f0a758f1a
improvement: Accept CancellationToken in JsonRpcRequestObservable
2024-10-14 17:21:45 +00:00
John Colvin
1d76c0c0ed
fix: Dispose market data sub in various md streams
2024-10-14 17:21:45 +00:00
John Colvin
89cb2b04bf
cleanup: Remove unused pubsub tag handler code
...
* Removed 'IPubSubServerTagHandler.register'
- All implementations of this function were empty
* Removed 'IPubSubServerTagHandler.supportedTagTypes'
- This property wasn't referenced anywhere
* Remove IWorker inheritance from IPubSubServerTagHandler
- No reason these interfaces have to be tied together
2024-10-14 17:21:45 +00:00
John Colvin
55f7a86500
refactor: Rename CloudStreamManager.cs -> RemoteQueryManager.cs
...
This matches the file name
2024-10-14 17:21:45 +00:00
John Colvin
86d01e73c4
Change pub sub schema prefix 'bluto://' -> 'bts-cloud://'
...
In config json files (not actual code change)
2024-10-14 17:21:45 +00:00
John Colvin
142aca7dc5
fix build: Fix prop names after refactoring PubSubRoute
...
* Change 'server_address' -> 'ServerAddress'
* Change 'tag_reg_exp' -> 'TagRegExp'
2024-10-14 17:21:45 +00:00
John Colvin
7b57a07a31
build: Add scripts to publish data stream apps
2024-10-14 17:21:45 +00:00
John Colvin
d6983ab359
Fix typo in log msg
2024-10-14 17:21:45 +00:00
John Colvin
dfa47bd88e
Fix build scripts so they propagate the exit code back to the shell
...
I noticed this was broken because launch.json configurations would still start the debugger
even when the preLaunchTask (build) failed!
2024-10-14 17:21:45 +00:00
John Colvin
9fcf23c0d7
vscode: Add DataStreamPublisher debug cfg to skip build
2024-10-14 17:21:45 +00:00
John Colvin
5a51d6e7f6
build: Use separate cmd to build DataStreamSuite/QueryAnalyzer.sln
...
The DataStreamSuite.sln builds the new webapp now, which will
(eventually) replace DSQA. We'll keep it around for now, but with a
clean separation from the main build.
2024-10-14 17:21:45 +00:00
John Colvin
fac11fdfe2
feat: Add DataStream WebApp
...
Included in DataStreamSuite.sln, but not DataStreamQueryAnalyzer.sln
2024-10-14 17:21:45 +00:00
John Colvin
4932388338
Add spark service modules designed for Dependency Injection
2024-10-14 17:21:45 +00:00
John Colvin
cccfbc7bd2
build: Copy libspark to all dotnet dirs in single cmake target
...
This is cleaner than the previous impl, which used separate build
targets to copy libspark to "net7.0", and "net7.0-windows" (dirs).
2024-10-14 17:21:45 +00:00
John Colvin
4d2cac7216
fix: Parse ServerAddress as normal string
...
The "JsonValueOrArrayConverter<T>" doesn't work the way I thought it
would. When it is associated with a property via the JsonConverter
attribute, dotnet json parsing code throws an exception if "T" isn't
assignable to the property type.
2024-10-14 17:21:45 +00:00
John Colvin
1c30546c24
fix build (api server): Change namespace to bts.websocket_core
2024-10-14 17:21:45 +00:00
John Colvin
c79ee0217a
Remove docker submodules again
2024-10-14 17:21:45 +00:00
John Colvin
a8b8e4215e
Change externals url from ssh to https style
...
So we don't need ssh keys to clone it (the builtin credential manager
makes https authentication safe/easy)
2024-10-14 17:21:45 +00:00
John Colvin
79f3431e77
cleanup: Fix benign typos in build scripts
...
Change BUILD_SPARK_PY var name to BUILD_PY (because these scripts to actually build 'spark')
2024-10-14 17:21:45 +00:00
John Colvin
9469906d4d
fix build (warn): Only use Registry on windows
2024-10-14 17:21:45 +00:00
John Colvin
de62ac6e82
cleanup: Fix numerous build warnings in DataStreamSuite
...
Nearly all warnings were due to nullability issues, since the concept of
nullable reference types did not exist when the DataStream code was
originally written.
* PubSubClientMessage
- Normalize indentation/whitespace
- Fix some typos
- Address nullability issues to fix build warnings
- Modernize code
* Compression related files
- ZipEntry
- ZipFile
- ZipInputStream
- TarHeader
* RemoteMessage
- make 'message' nullable to resolve warnings elsewhere (in calling code)
* PubSubSingleTagStateEvent.cs
* PubSubMessageReactor
* PubSubState
* SystemHeartbeatPublisher
* SystemStatsPublisher
* SingleTagData
* ManagedTCPMessageHub
* PubsubDeserializationController
* PublisherCore
* InflaterHuffmanTree
* AsyncTCPConnection_APM
* ThreadSafeQueue
* ManagedSubscriber
* SubscriberCore
* PubSubServerManagedTCPConnection
* AsyncTCPConnection_APM
* SuperMapStream
* MapStream
* TradeBarsStream
2024-10-14 17:21:45 +00:00
John Colvin
4340910285
cleanup: Normalize indentation in TradeBarsStream
2024-10-14 17:21:45 +00:00
John Colvin
3b5e8d6e7e
cleanup: Disable nullability warnings
...
* BZip2InputStream
* TarInputStream
* Inflater
* InflaterDynHeader
* BZip2OutputStream
* DeflaterHuffman
* ParallelJoinTest
2024-10-14 17:21:45 +00:00
John Colvin
2fab790ebf
cleanup: Modernize PubSubRoute code, json parsing
2024-10-14 17:21:45 +00:00
John Colvin
06352bd6e9
cleanup: Remove unused DateTime grammar from exp parser
2024-10-14 17:21:45 +00:00
John Colvin
ea4c91116f
Add JsonRpcRequestObservable, AsyncEnumerable
2024-10-14 17:21:45 +00:00
John Colvin
f7c2fc52ce
Add json facilities for DataStream websocket api
2024-10-14 17:21:45 +00:00
John Colvin
7882c5ca77
refactor: Add handy WebsocketExtensions
...
* IsSocketStateOpen
* IsClosedProperly
2024-10-14 17:21:45 +00:00
John Colvin
91b9d2a37b
feat: Add JsonRpc types for websocket paradigm
2024-10-14 17:21:45 +00:00
John Colvin
48419e8d3c
cleanup: Remove empty file (clearly added by accident)
2024-10-14 17:21:45 +00:00
John Colvin
66511d69bb
fix: Fix improper 'OfType' linq cast
...
Previously, animations were expressed through polymorphism (derived from the
base class CellAnimation), but the new impl uses composition. This 'OfType' call
was leftover from the polymorphism implementation, an attempt to linq cast
elements of base class (CellAnimation) to BackgroundAnimation.
2024-10-14 17:21:45 +00:00
John Colvin
68a6e716f7
editorconfig: Use standard c# capitalization rules
...
* Use 'PascalCase' for public members (instead of 'snake_case')
* Use 'camelCase' for private members (instead of '_snake_case')
2024-10-14 17:21:45 +00:00
John Colvin
5d28d0e455
refactor: Add WebsocketClient class
...
Basically an ISubject (I/O) wrapper for IWebsocketConnectionGateway
2024-10-14 17:21:45 +00:00
John Colvin
8db44cc7f5
refactor: Change WebsocketServerConfig.port to uint32
...
It should always be a number between 1-65535
2024-10-14 17:21:45 +00:00
John Colvin
91220a0296
refactor: Rename WebsocketServerConfig proto pkg 'bts.websocket_core'
...
This matches the namespace used in spark_websocket csproj. Eventually,
I'd like to use conventional capitalization (TitleCase namespaces/types,
etc.), but let's shelf that until we have enough time/energy to do a
more comprehensive refactoring.
2024-10-14 17:21:45 +00:00
John Colvin
9709112307
refactor: Remove nullability constraint in GetValueOrDefault
2024-10-14 17:21:44 +00:00
John Colvin
82128be9ca
refactor: Use events to avoid circular deps for ws sync/gateway
2024-10-14 17:21:44 +00:00
John Colvin
fd59682b28
refactor: Let caller specify nullability of T in json parse fn
2024-10-14 17:21:44 +00:00
Adeel Khan
2324fd3ad2
CHANGE: Taifex State Mgmt
2024-10-14 20:59:34 +05:00
Mohammad Arham
8850bf4903
Remove: Assert in taifex code
2024-10-09 14:53:20 +00:00