Commit Graph
13369 Commits
Author SHA1 Message Date
John Colvin 554ceea2ee check pt 2024-07-07 22:19:25 +00:00
John Colvin d54b0437b0 Add config for PubSub tag handler factory 2024-07-05 13:50:39 +00:00
John Colvin 81f51352b4 devcontainer: Install dotnet8 expose ports for DataStream Web App 2024-07-04 17:33:37 +00:00
John Colvin 6f521f8f6a fix build: Copy libspark to net8.0 dir
For the DataStream Web App
2024-07-04 17:33:37 +00:00
John Colvin 7a0f36f686 fix build: Copy dll to all dirs in DOTNET_BINARY_DIR
Needed to wrap the var in double quotes
2024-07-04 17:33:37 +00:00
John Colvin a14aa58a24 build: Add scripts to publish data stream apps 2024-07-04 17:33:37 +00:00
John Colvin 667ec4ca10 Fix typo in log msg 2024-07-04 17:33:37 +00:00
John Colvin 7698fa15f6 Fix work scheduler issues 2024-07-04 13:32:22 -04:00
John Colvin e78b405139 refactor: Remove JsonPropertyName attributes from PubSubConfig
The ApplicationBuilder doesn't support these attributes when parsing config.
2024-07-04 13:32:22 -04:00
John Colvin bf96899fa3 refactor: Add config for IPubSubTagHandlerFactory 2024-07-04 13:32:22 -04:00
John Colvin e919aa9d05 fix: Make sure transient streams are attached to IServiceProvider
So they can retrieve services necessary to function (e.g., add themselves
to the master IWorkScheduler so doWork gets called, etc.)
2024-07-04 13:32:22 -04:00
John Colvin a05c7410dc refactor: Use DependencyInjection paradigm in DataStreamSuite
This allows us to create loosely coupled services with automatic
dependency resolution
2024-07-02 11:30:14 -04:00
John Colvin 6cc0ad4f66 Fix net7 -> net8 typo in publish_data_stream_web_app.py
The DataStream Web App is on net8
2024-07-01 23:36:04 -04:00
John Colvin 8fff414c4c Fix build scripts so they propagate the exit code back to the shell
I noticed this was broken because launch.json configurations would still start the debugger
even when the preLaunchTask (build) failed!
2024-07-01 23:36:04 -04:00
John Colvin 8421e4ae1a Change PubSub scheme prefix from 'bluto' -> 'bts-cloud' 2024-07-01 23:36:04 -04:00
Taha a8d0712e30 Added pubsub routes to the Title of DSQA 2024-07-01 23:36:04 -04:00
John Colvin aa36a7393c vscode: Add DataStreamPublisher debug cfg to skip build 2024-07-01 11:23:46 -04:00
John Colvin 7e0d5e4f59 build: Use separate cmd to build DataStreamSuite/QueryAnalyzer.sln
The DataStreamSuite.sln builds the new webapp now, which will
(eventually) replace DSQA. We'll keep it around for now, but with a
clean separation from the main build.
2024-07-01 11:23:46 -04:00
John Colvin d26e653a6b Tweak grid colors in DataStream web app 2024-07-01 11:23:46 -04:00
John Colvin 56e087ab8b refactor: Move DataStreamWebApp themes to their own js file 2024-07-01 11:23:45 -04:00
Taha c71bb8c301 Fixing the bug where messages were being sent by the pubsubserver out of order 2024-06-27 01:32:18 -04:00
John Colvin 44d6173ddf feat: Add DataStream WebApp
Included in DataStreamSuite.sln, but not DataStreamQueryAnalyzer.sln
2024-06-26 14:33:04 -04:00
John Colvin 322152c743 build: Copy libspark to all dotnet dirs in single cmake target
This is cleaner than the previous impl, which used separate build
targets to copy libspark to "net7.0", and "net7.0-windows" (dirs).

Note: I decided to clean this up now because I'm about to upgrade the
new DataStream WebApp to net8.0, and did not want to add yet another
build target to copy libspark to "net8.0".
2024-06-26 14:33:04 -04:00
John Colvin 9ab39587e2 fix: Parse ServerAddress as normal string
The "JsonValueOrArrayConverter<T>" doesn't work the way I thought it
would. When it is associated with a property via the JsonConverter
attribute, dotnet json parsing code throws an exception if "T" isn't
assignable to the property type.
2024-06-26 14:33:04 -04:00
John Colvin 72f59924ea fix build (api server): Change namespace to bts.websocket_core 2024-06-26 14:33:04 -04:00
John Colvin 98ab9741b5 fix build: Update vcpkg
On some vs versions, vcpkg cmake scripts would fail w/ an error saying
"Could not locate a complete Visual Studio instance"
2024-06-26 14:33:04 -04:00
John Colvin 11f0143845 Remove docker/windows again? 2024-06-26 14:33:04 -04:00
John Colvin 35d47f9cce Remove docker/linux again? 2024-06-26 14:33:04 -04:00
John Colvin 18662fcc0d Change externals url from ssh to https style
So we don't need ssh keys to clone it (the builtin credential manager
makes https authentication safe/easy)
2024-06-26 14:33:04 -04:00
John Colvin 16ffc48846 cleanup: Fix benign typos in build scripts
Change BUILD_SPARK_PY var name to BUILD_PY (because these scripts to actually build 'spark')
2024-06-26 14:33:04 -04:00
John Colvin 3cf388f041 fix build (warn): Only use Registry on windows 2024-06-26 14:33:03 -04:00
John Colvin 3e401a766d cleanup: Fix numerous build warnings in DataStreamSuite
Nearly all warnings were due to nullability issues, since the concept of
nullable reference types did not exist when the DataStream code was
originally written.

* PubSubClientMessage
  - Normalize indentation/whitespace
  - Fix some typos
  - Address nullability issues to fix build warnings
  - Modernize code

* Compression related files
  - ZipEntry
  - ZipFile
  - ZipInputStream
  - TarHeader

* RemoteMessage
  - make 'message' nullable to resolve warnings elsewhere (in calling code)

* PubSubSingleTagStateEvent.cs
* PubSubMessageReactor
* PubSubState
* SystemHeartbeatPublisher
* SystemStatsPublisher
* SingleTagData
* ManagedTCPMessageHub
* PubsubDeserializationController
* PublisherCore
* InflaterHuffmanTree
* AsyncTCPConnection_APM
* ThreadSafeQueue
* ManagedSubscriber
* SubscriberCore
* PubSubServerManagedTCPConnection
* AsyncTCPConnection_APM
* SuperMapStream
* MapStream
* TradeBarsStream
2024-06-26 14:33:03 -04:00
John Colvin b16ff50120 cleanup: Normalize indentation in TradeBarsStream 2024-06-26 14:33:03 -04:00
John Colvin 44564f7d56 cleanup: Disable nullability warnings
* BZip2InputStream
* TarInputStream
* Inflater
* InflaterDynHeader
* BZip2OutputStream
* DeflaterHuffman
* ParallelJoinTest
2024-06-26 14:33:03 -04:00
John Colvin eaa5580e89 cleanup: Modernize PubSubRoute code, json parsing 2024-06-26 14:33:03 -04:00
John Colvin 5de4e31880 cleanup: Remove unused DateTime grammar from exp parser 2024-06-26 14:33:03 -04:00
John Colvin 7cf90d95da Add JsonRpcRequestObservable, AsyncEnumerable 2024-06-26 14:33:03 -04:00
John Colvin ec36d84412 Add json facilities for DataStream websocket api 2024-06-26 14:33:03 -04:00
John Colvin 95aad773a2 refactor: Add handy WebsocketExtensions
* IsSocketStateOpen
* IsClosedProperly
2024-06-26 14:33:03 -04:00
John Colvin fb476de0a3 feat: Add JsonRpc types for websocket paradigm 2024-06-26 14:33:03 -04:00
John Colvin 41b42719ce cleanup: Remove empty file (clearly added by accident) 2024-06-26 14:33:03 -04:00
John Colvin c1f8aadd5d fix: Fix improper 'OfType' linq cast
Previously, animations were expressed through polymorphism (derived from the
base class CellAnimation), but the new impl uses composition. This 'OfType' call
was leftover from the polymorphism implementation, an attempt to linq cast
elements of base class (CellAnimation) to BackgroundAnimation.
2024-06-26 14:33:03 -04:00
John Colvin ad5e0c77fe editorconfig: Use standard c# capitalization rules
* Use 'PascalCase' for public members (instead of 'snake_case')
* Use 'camelCase' for private members (instead of '_snake_case')
2024-06-26 14:33:03 -04:00
John Colvin 90ee45db30 refactor: Add WebsocketClient class
Basically an ISubject (I/O) wrapper for IWebsocketConnectionGateway
2024-06-26 14:33:03 -04:00
John Colvin 6dd701dd33 refactor: Change WebsocketServerConfig.port to uint32
It should always be a number between 1-65535
2024-06-26 14:33:03 -04:00
John Colvin 456c953839 refactor: Rename WebsocketServerConfig proto pkg 'bts.websocket_core'
This matches the namespace used in spark_websocket csproj. Eventually,
I'd like to use conventional capitalization (TitleCase namespaces/types,
etc.), but let's shelf that until we have enough time/energy to do a
more comprehensive refactoring.
2024-06-26 14:33:03 -04:00
John Colvin 492f02eb21 refactor: Remove nullability constraint in GetValueOrDefault 2024-06-26 14:33:03 -04:00
John Colvin 41d2fd9c51 refactor: Use events to avoid circular deps for ws sync/gateway 2024-06-26 14:33:03 -04:00
John Colvin 59f3c446ba refactor: Let caller specify nullability of T in json parse fn 2024-06-26 14:33:03 -04:00
Taha 9aadda2429 some buf gixes + cleanup 2024-06-26 14:29:22 -04:00