John Colvin
c3ef18e649
datastream webapp client check pt
2024-11-25 15:26:57 +00:00
John Colvin
feaf2cc6b4
Remove unused PubSubConfig props
2024-11-25 15:26:57 +00:00
John Colvin
e184c850d1
Fix dsqa config json
2024-11-25 15:26:57 +00:00
John Colvin
161fdfa463
fix: Always call 'handle_internal_pubs' in PubSubMessageReactor main loop
2024-11-25 15:26:57 +00:00
John Colvin
9c184d7203
improvement: Accept CancellationToken, catch exceptions when running ds websocket server
2024-11-25 15:26:57 +00:00
John Colvin
a2344e1494
Fix mismatched types in PubSubServerTagStatsStream schema
2024-11-25 15:26:57 +00:00
John Colvin
cc153a1ced
Add DataStreamPublisher service modules designed for Dependency Injection
...
* Change DataStreamPublisher json fields to match cs class property names verbatim
* Rename Publishers -> PublisherNodes in DataStreamPublisherConfig
2024-11-25 15:26:57 +00:00
John Colvin
b19f720e42
refactor: Decouple ViewPublisher from IPubTableBroker impl
2024-11-25 15:26:57 +00:00
John Colvin
51d934de27
Add PubSub service modules designed for Dependency Injection
...
* Get rid of JsonPropertyName attributes in PubSubConfig
- The Dependency Injection framework (based around dotnet ApplicationBuilder)
does not support this attribute, and maps property names verbatim to json fields.
* Change PubSubServer json fields to match cs class property names verbatim
2024-11-25 15:26:57 +00:00
John Colvin
23e47f1749
refactor: Decouple RemoteQueryManager from IManagedSubscriber, IPubTableBroker impl
2024-11-25 15:26:57 +00:00
John Colvin
a5a905e20f
refactor: Decouple ManagedSubscriber from ISubscriberCore impl
2024-11-25 15:26:57 +00:00
John Colvin
1cecbe9276
refactor: Only support 1 tag type in IPubSubServerTagHandler
2024-11-25 15:26:57 +00:00
John Colvin
edfc1fc0d7
refactor: Decouple PubTableBroker from IPublisherCore impl
...
Reference interface rather than the PublisherCore impl.
2024-11-25 15:26:57 +00:00
John Colvin
cb43af0dd4
improvement: Accept CancellationToken in JsonRpcRequestObservable
2024-11-25 15:26:57 +00:00
John Colvin
70616d4a09
fix: Dispose market data sub in various md streams
2024-11-25 15:26:57 +00:00
John Colvin
6ec15d34a7
cleanup: Remove unused pubsub tag handler code
...
* Removed 'IPubSubServerTagHandler.register'
- All implementations of this function were empty
* Removed 'IPubSubServerTagHandler.supportedTagTypes'
- This property wasn't referenced anywhere
* Remove IWorker inheritance from IPubSubServerTagHandler
- No reason these interfaces have to be tied together
2024-11-25 15:26:57 +00:00
John Colvin
48b3852e6f
refactor: Rename CloudStreamManager.cs -> RemoteQueryManager.cs
...
This matches the file name
2024-11-25 15:26:57 +00:00
John Colvin
595656f298
Change pub sub schema prefix 'bluto://' -> 'bts-cloud://'
...
In config json files (not actual code change)
2024-11-25 15:26:57 +00:00
John Colvin
951d68e20c
fix build: Fix prop names after refactoring PubSubRoute
...
* Change 'server_address' -> 'ServerAddress'
* Change 'tag_reg_exp' -> 'TagRegExp'
2024-11-25 15:26:57 +00:00
John Colvin
d64ddb3477
build: Add scripts to publish data stream apps
2024-11-25 15:26:57 +00:00
John Colvin
d937054f6f
Fix typo in log msg
2024-11-25 15:26:57 +00:00
John Colvin
61affcf749
Fix build scripts so they propagate the exit code back to the shell
...
I noticed this was broken because launch.json configurations would still start the debugger
even when the preLaunchTask (build) failed!
2024-11-25 15:26:57 +00:00
John Colvin
7270967181
vscode: Add DataStreamPublisher debug cfg to skip build
2024-11-25 15:26:57 +00:00
John Colvin
008e84dcf0
build: Use separate cmd to build DataStreamSuite/QueryAnalyzer.sln
...
The DataStreamSuite.sln builds the new webapp now, which will
(eventually) replace DSQA. We'll keep it around for now, but with a
clean separation from the main build.
2024-11-25 15:26:57 +00:00
John Colvin
9cc0108a01
feat: Add DataStream WebApp
...
Included in DataStreamSuite.sln, but not DataStreamQueryAnalyzer.sln
2024-11-25 15:26:57 +00:00
John Colvin
6c1d1a43f5
Add spark service modules designed for Dependency Injection
2024-11-25 15:26:57 +00:00
John Colvin
d96b6da139
build: Copy libspark to all dotnet dirs in single cmake target
...
This is cleaner than the previous impl, which used separate build
targets to copy libspark to "net7.0", and "net7.0-windows" (dirs).
2024-11-25 15:26:57 +00:00
John Colvin
295300e7fa
fix: Parse ServerAddress as normal string
...
The "JsonValueOrArrayConverter<T>" doesn't work the way I thought it
would. When it is associated with a property via the JsonConverter
attribute, dotnet json parsing code throws an exception if "T" isn't
assignable to the property type.
2024-11-25 15:26:57 +00:00
John Colvin
b35b9170e4
fix build (api server): Change namespace to bts.websocket_core
2024-11-25 15:26:57 +00:00
John Colvin
e57e401780
Remove docker submodules again
2024-11-25 15:26:57 +00:00
John Colvin
f5c333b84c
Change externals url from ssh to https style
...
So we don't need ssh keys to clone it (the builtin credential manager
makes https authentication safe/easy)
2024-11-25 15:26:57 +00:00
John Colvin
60c784f371
cleanup: Fix benign typos in build scripts
...
Change BUILD_SPARK_PY var name to BUILD_PY (because these scripts to actually build 'spark')
2024-11-25 15:26:57 +00:00
John Colvin
68fe50f7e2
fix build (warn): Only use Registry on windows
2024-11-25 15:26:57 +00:00
John Colvin
7ebafd8246
cleanup: Fix numerous build warnings in DataStreamSuite
...
Nearly all warnings were due to nullability issues, since the concept of
nullable reference types did not exist when the DataStream code was
originally written.
* PubSubClientMessage
- Normalize indentation/whitespace
- Fix some typos
- Address nullability issues to fix build warnings
- Modernize code
* Compression related files
- ZipEntry
- ZipFile
- ZipInputStream
- TarHeader
* RemoteMessage
- make 'message' nullable to resolve warnings elsewhere (in calling code)
* PubSubSingleTagStateEvent.cs
* PubSubMessageReactor
* PubSubState
* SystemHeartbeatPublisher
* SystemStatsPublisher
* SingleTagData
* ManagedTCPMessageHub
* PubsubDeserializationController
* PublisherCore
* InflaterHuffmanTree
* AsyncTCPConnection_APM
* ThreadSafeQueue
* ManagedSubscriber
* SubscriberCore
* PubSubServerManagedTCPConnection
* AsyncTCPConnection_APM
* SuperMapStream
* MapStream
* TradeBarsStream
2024-11-25 15:26:57 +00:00
John Colvin
8f2e37d644
cleanup: Disable nullability warnings
...
* BZip2InputStream
* TarInputStream
* Inflater
* InflaterDynHeader
* BZip2OutputStream
* DeflaterHuffman
* ParallelJoinTest
2024-11-25 15:26:57 +00:00
John Colvin
426b0daf61
cleanup: Modernize PubSubRoute code, json parsing
2024-11-25 15:26:56 +00:00
John Colvin
5d71d7f01b
cleanup: Remove unused DateTime grammar from exp parser
2024-11-25 15:26:56 +00:00
John Colvin
1fa1dfa01e
Add JsonRpcRequestObservable, AsyncEnumerable
2024-11-25 15:26:56 +00:00
John Colvin
ec28e12a6f
Add json facilities for DataStream websocket api
2024-11-25 15:26:56 +00:00
John Colvin
84b7e74bb6
refactor: Add handy WebsocketExtensions
...
* IsSocketStateOpen
* IsClosedProperly
2024-11-25 15:26:56 +00:00
John Colvin
64ffd3050f
feat: Add JsonRpc types for websocket paradigm
2024-11-25 15:26:56 +00:00
John Colvin
1f2f7dda09
cleanup: Remove empty file (clearly added by accident)
2024-11-25 15:26:56 +00:00
John Colvin
60de12277b
fix: Fix improper 'OfType' linq cast
...
Previously, animations were expressed through polymorphism (derived from the
base class CellAnimation), but the new impl uses composition. This 'OfType' call
was leftover from the polymorphism implementation, an attempt to linq cast
elements of base class (CellAnimation) to BackgroundAnimation.
2024-11-25 15:26:56 +00:00
John Colvin
963a521a2c
editorconfig: Use standard c# capitalization rules
...
* Use 'PascalCase' for public members (instead of 'snake_case')
* Use 'camelCase' for private members (instead of '_snake_case')
2024-11-25 15:26:56 +00:00
John Colvin
00ce3cdf37
refactor: Add WebsocketClient class
...
Basically an ISubject (I/O) wrapper for IWebsocketConnectionGateway
2024-11-25 15:26:56 +00:00
John Colvin
fbdb4f112d
refactor: Change WebsocketServerConfig.port to uint32
...
It should always be a number between 1-65535
2024-11-25 15:26:56 +00:00
John Colvin
2f9f20de06
refactor: Rename WebsocketServerConfig proto pkg 'bts.websocket_core'
...
This matches the namespace used in spark_websocket csproj. Eventually,
I'd like to use conventional capitalization (TitleCase namespaces/types,
etc.), but let's shelf that until we have enough time/energy to do a
more comprehensive refactoring.
2024-11-25 15:26:56 +00:00
John Colvin
c7b5b5df54
refactor: Remove nullability constraint in GetValueOrDefault
2024-11-25 15:26:56 +00:00
John Colvin
9342613501
refactor: Use events to avoid circular deps for ws sync/gateway
2024-11-25 15:26:56 +00:00
Mohammad Arham
0e893b9b5d
Fix: Multiple Exchange data sources work without timee
2024-11-20 23:48:50 +00:00