John Colvin
7739cc2f3d
Use Dependency Injection in Bts.DataStreamWebApp.Server
2024-07-11 10:37:29 -04:00
John Colvin
8347a7c126
refactor: Change Bts.DataStreamWebApp.Server framework from net8 -> net7
...
Although it would build on net8, all other cs code targets net7. Furthermore,
VS Code intellisense seems less reliable/crashes frequently when the sln file
targets both frameworks).
2024-07-11 10:37:28 -04:00
John Colvin
fbfc960df6
improvement: Make DataStreamSubscription an IHostedService
...
To properly manage its life cycle
2024-07-11 10:37:28 -04:00
John Colvin
451f721030
improvement: Accept CancellationToken, catch exceptions when running ds websocket server
2024-07-11 10:37:28 -04:00
John Colvin
bb992c0410
Fix mismatched types in PubSubServerTagStatsStream schema
2024-07-11 10:37:28 -04:00
John Colvin
db18aebf92
Add DataStreamPublisher service modules designed for Dependency Injection
2024-07-11 10:37:28 -04:00
John Colvin
8127c9c9fe
refactor: Decouple ViewPublisher from IPubTableBroker impl
2024-07-11 10:37:28 -04:00
John Colvin
1825b339b1
Change PubSubServer json fields to match cs class property names verbatim
2024-07-11 10:37:28 -04:00
John Colvin
03ab3fbe90
Get rid of JsonPropertyName attributes in PubSubConfig
...
The Dependency Injection framework (based around dotnet ApplicationBuilder)
does not support this attribute, and maps property names verbatim to json fields.
2024-07-11 10:37:28 -04:00
John Colvin
b61bf16a42
Add PubSub service modules designed for Dependency Injection
2024-07-11 10:37:28 -04:00
John Colvin
d969489bf4
refactor: Decouple RemoteQueryManager from IManagedSubscriber, IPubTableBroker impl
2024-07-11 10:37:28 -04:00
John Colvin
9cd4974f49
refactor: Decouple ManagedSubscriber from ISubscriberCore impl
2024-07-11 10:37:28 -04:00
John Colvin
793634c8cb
refactor: Only support 1 tag type in IPubSubServerTagHandler
2024-07-11 10:37:28 -04:00
John Colvin
eae20b6c94
refactor: Decouple PubTableBroker from IPublisherCore impl
...
Reference interface rather than the PublisherCore impl.
2024-07-11 10:37:28 -04:00
John Colvin
2848bb6a5d
improvement: Accept CancellationToken in JsonRpcRequestObservable
2024-07-11 10:37:16 -04:00
John Colvin
687324998b
Add spark service modules designed for Dependency Injection
2024-07-11 10:36:04 -04:00
John Colvin
97cebd62d4
fix: Dispose market data sub in various md streams
2024-07-11 10:36:04 -04:00
John Colvin
492ca0c28f
cleanup: Remove unused pubsub tag handler code
...
* Removed 'IPubSubServerTagHandler.register'
- All implementations of this function were empty
* Removed 'IPubSubServerTagHandler.supportedTagTypes'
- This property wasn't referenced anywhere
* Remove IWorker inheritance from IPubSubServerTagHandler
- No reason these interfaces have to be tied together
2024-07-10 13:35:18 -04:00
John Colvin
baa5019039
refactor: Rename CloudStreamManager.cs -> RemoteQueryManager.cs
...
This matches the file name
2024-07-10 01:18:21 -04:00
John Colvin
ac2d31e1fc
fix build: Update vcpkg
...
On some vs versions, vcpkg cmake scripts would fail w/ an error saying
"Could not locate a complete Visual Studio instance"
2024-07-09 15:16:36 -04:00
John Colvin
9821134bc3
Change pub sub schema prefix 'bluto://' -> 'bts-cloud://'
...
In config json files (not actual code change)
2024-07-09 15:14:30 -04:00
John Colvin
9cf892322d
fix build: Fix prop names after refactoring PubSubRoute
...
* Change 'server_address' -> 'ServerAddress'
* Change 'tag_reg_exp' -> 'TagRegExp'
2024-07-09 15:14:30 -04:00
John Colvin
77bf91be1e
build: Add scripts to publish data stream apps
2024-07-09 15:14:30 -04:00
John Colvin
63b064ac79
Fix typo in log msg
2024-07-09 15:14:30 -04:00
John Colvin
b617775c29
Fix net7 -> net8 typo in publish_data_stream_web_app.py
...
The DataStream Web App is on net8
2024-07-09 15:14:30 -04:00
John Colvin
4f7d77420c
Fix build scripts so they propagate the exit code back to the shell
...
I noticed this was broken because launch.json configurations would still start the debugger
even when the preLaunchTask (build) failed!
2024-07-09 15:14:30 -04:00
John Colvin
3ba6a91ca7
vscode: Add DataStreamPublisher debug cfg to skip build
2024-07-09 15:14:30 -04:00
John Colvin
0abde9eb7c
build: Use separate cmd to build DataStreamSuite/QueryAnalyzer.sln
...
The DataStreamSuite.sln builds the new webapp now, which will
(eventually) replace DSQA. We'll keep it around for now, but with a
clean separation from the main build.
2024-07-09 15:14:30 -04:00
John Colvin
1531a57bc5
feat: Add DataStream WebApp
...
Included in DataStreamSuite.sln, but not DataStreamQueryAnalyzer.sln
2024-07-09 15:14:29 -04:00
John Colvin
a62ea64c5e
build: Copy libspark to all dotnet dirs in single cmake target
...
This is cleaner than the previous impl, which used separate build
targets to copy libspark to "net7.0", and "net7.0-windows" (dirs).
Note: I decided to clean this up now because I'm about to upgrade the
new DataStream WebApp to net8.0, and did not want to add yet another
build target to copy libspark to "net8.0".
2024-07-09 15:14:29 -04:00
John Colvin
450773f588
fix: Parse ServerAddress as normal string
...
The "JsonValueOrArrayConverter<T>" doesn't work the way I thought it
would. When it is associated with a property via the JsonConverter
attribute, dotnet json parsing code throws an exception if "T" isn't
assignable to the property type.
2024-07-09 15:14:29 -04:00
John Colvin
f09d6badaf
fix build (api server): Change namespace to bts.websocket_core
2024-07-09 15:14:29 -04:00
John Colvin
6b054e0718
Remove docker submodules again
2024-07-09 15:14:29 -04:00
John Colvin
5e2789d16e
Change externals url from ssh to https style
...
So we don't need ssh keys to clone it (the builtin credential manager
makes https authentication safe/easy)
2024-07-09 15:14:29 -04:00
John Colvin
9ebdb2e460
cleanup: Fix benign typos in build scripts
...
Change BUILD_SPARK_PY var name to BUILD_PY (because these scripts to actually build 'spark')
2024-07-09 15:14:29 -04:00
John Colvin
d7bf82722b
fix build (warn): Only use Registry on windows
2024-07-09 15:14:29 -04:00
John Colvin
e1526e25a7
cleanup: Fix numerous build warnings in DataStreamSuite
...
Nearly all warnings were due to nullability issues, since the concept of
nullable reference types did not exist when the DataStream code was
originally written.
* PubSubClientMessage
- Normalize indentation/whitespace
- Fix some typos
- Address nullability issues to fix build warnings
- Modernize code
* Compression related files
- ZipEntry
- ZipFile
- ZipInputStream
- TarHeader
* RemoteMessage
- make 'message' nullable to resolve warnings elsewhere (in calling code)
* PubSubSingleTagStateEvent.cs
* PubSubMessageReactor
* PubSubState
* SystemHeartbeatPublisher
* SystemStatsPublisher
* SingleTagData
* ManagedTCPMessageHub
* PubsubDeserializationController
* PublisherCore
* InflaterHuffmanTree
* AsyncTCPConnection_APM
* ThreadSafeQueue
* ManagedSubscriber
* SubscriberCore
* PubSubServerManagedTCPConnection
* AsyncTCPConnection_APM
* SuperMapStream
* MapStream
* TradeBarsStream
2024-07-09 15:14:26 -04:00
John Colvin
089ba9b369
cleanup: Normalize indentation in TradeBarsStream
2024-07-09 15:09:02 -04:00
John Colvin
567976043f
cleanup: Disable nullability warnings
...
* BZip2InputStream
* TarInputStream
* Inflater
* InflaterDynHeader
* BZip2OutputStream
* DeflaterHuffman
* ParallelJoinTest
2024-07-09 15:07:24 -04:00
John Colvin
2fd3382939
cleanup: Modernize PubSubRoute code, json parsing
2024-07-09 15:06:34 -04:00
John Colvin
a96f1c8f17
cleanup: Remove unused DateTime grammar from exp parser
2024-07-09 15:03:30 -04:00
John Colvin
6f623f9a37
Add JsonRpcRequestObservable, AsyncEnumerable
2024-07-09 15:03:30 -04:00
John Colvin
827189cdb4
Add json facilities for DataStream websocket api
2024-07-09 15:03:30 -04:00
John Colvin
123f12ab88
refactor: Add handy WebsocketExtensions
...
* IsSocketStateOpen
* IsClosedProperly
2024-07-09 14:59:06 -04:00
John Colvin
f51ba8fb56
feat: Add JsonRpc types for websocket paradigm
2024-07-09 14:59:06 -04:00
John Colvin
2506fb4f2b
cleanup: Remove empty file (clearly added by accident)
2024-07-09 14:59:06 -04:00
John Colvin
f92964114e
fix: Fix improper 'OfType' linq cast
...
Previously, animations were expressed through polymorphism (derived from the
base class CellAnimation), but the new impl uses composition. This 'OfType' call
was leftover from the polymorphism implementation, an attempt to linq cast
elements of base class (CellAnimation) to BackgroundAnimation.
2024-07-09 14:59:06 -04:00
John Colvin
baa0f1430b
editorconfig: Use standard c# capitalization rules
...
* Use 'PascalCase' for public members (instead of 'snake_case')
* Use 'camelCase' for private members (instead of '_snake_case')
2024-07-09 14:59:06 -04:00
John Colvin
7104bd787a
refactor: Add WebsocketClient class
...
Basically an ISubject (I/O) wrapper for IWebsocketConnectionGateway
2024-07-09 14:59:06 -04:00
John Colvin
5db92d1f7d
refactor: Change WebsocketServerConfig.port to uint32
...
It should always be a number between 1-65535
2024-07-09 14:59:06 -04:00