Commit Graph
11994 Commits
Author SHA1 Message Date
John Colvin 68f75a6f44 cleanup: Get rid of magic const (subscriptionId) in webapp App.jsx 2024-09-18 14:02:37 +00:00
John Colvin ad0b6968ad build: Copy configuration profiles to publish dir 2024-09-18 14:02:37 +00:00
John Colvin fdaff5dcf5 cleanup: Remove unnecessary deps from csprojs 2024-09-18 14:02:37 +00:00
John Colvin c05d90fd26 fix: Downgrade Microsoft.Extensions.Hosting to 7.0.1
A handful of csprojs were referencing version 8.0.0. Since that version
targets net8.0, I have no idea why it didn't cause the build to fail.
Instead, this framework mismatch led to a mysterious runtime crash with
the following error, despite the dll in question being present in the
build dir:

Unhandled exception. System.IO.FileNotFoundException: Could not load file or assembly 'System.Diagnostics.DiagnosticSource, Version=8.0.0.0, Culture=neutral, PublicKeyToken=cc7b13ffcd2ddd51'.
The system cannot find the file specified.

It is worth noting that this crash would only happen for exes published
as part of the DataStreamSuite.sln with the "--self-contained" flag. For
example, the Bts.DataStreamSuite.Server exe would always fail if
published via:

dotnet publish --configuration Release --sc --framework net7.0 --runtime linux-x64 <DataStreamSuite.sln>
2024-09-18 14:02:37 +00:00
John Colvin 51f60188f5 Add HttpsRedirection middleware first in the webapp pipeline
Middleware handlers are invoked in the order in which they are added. Any middleware
that is added before HttpsRedirection may can prevent the request from being redirected.
As of now, only development-specific middleware is added ahead of HttpsRedircetion.
2024-09-18 14:02:37 +00:00
John Colvin cf93176991 build: Copy configuration profiles to build dir
So they are readily available to publish/deploy scripts.
2024-09-18 14:02:37 +00:00
John Colvin 6aa9307a3c Fix benign typo in Scanner/Parser msbuild targets
The output path referenced a non-existant msbuild metadata prop "RelativeOutputDir"
(the actual prop is called "RelativeDir"). Also, the OutputFile path is relative to the
project dir (the 'MSBuildProjectDir' prop), not the file being included.
2024-09-18 14:02:37 +00:00
John Colvin 3eb3cfbf9f fix: Catch exception when creating TcpClient 2024-09-18 14:02:37 +00:00
John Colvin 501671c9c5 fix: Catch WebSocketException in DataStreamSubscription 2024-09-18 14:02:37 +00:00
John Colvin 9d62fcde3d fix: Add null check to NonIncGroupByStream 2024-09-18 14:02:37 +00:00
John Colvin 50b4c8807e fix: Add null check to TableAccumulator2 2024-09-18 14:02:36 +00:00
John Colvin fb528d4683 fix: Make SystemSubscriptionMapPublisher threadsafe
The PubSubState.onTagMapChanged event may not be invoked on
the same thread as doWork.
2024-09-18 14:02:36 +00:00
John Colvin f1b2206577 fix: Add null check in TimeBasedFilter.cs 2024-09-18 14:02:36 +00:00
John Colvin 68d1865f36 Reduce task wait/timeout code in AsyncTCPConnector 2024-09-18 14:02:36 +00:00
John Colvin 3c8431837b Add a few canned queries to AwsProd.json for ds webapp 2024-09-18 14:02:36 +00:00
John Colvin e0d413b884 fix: Copy canned queries to clipboard on click
Instead of trying to update the text directly, which causes the front end
to overwrite the user's changes everytime the data updates from then on.
2024-09-18 14:02:36 +00:00
John Colvin ff8ebaa326 fix: Convert invalid doubles to nan in ds webapp serializer 2024-09-18 14:02:36 +00:00
John Colvin 370b84b6dd Increase datagrid maxheight in ds webapp to 1000px 2024-09-18 14:02:36 +00:00
John Colvin 715246c9c7 Improve error display in ds webapp 2024-09-18 14:02:36 +00:00
John Colvin a1f195721a fix: Dispose existing sub on subscribe req in ds webapp
Even if new sub has parse error. This fixes a bug where the previous
subscription would continue firing and updating the frontend, when it
should just display the error info to the user and cease updates.
2024-09-18 14:02:36 +00:00
John Colvin d7de423e35 fix: Get rid of "UseSpa" calls in webapp Production environment
This was leftover from a misguided attempt to fix a bug that turned out
to be due to an omitted environment var:
ASPNETCORE_HOSTINGSTARTUPASSEMBLIES=Microsoft.AspNetCore.SpaProxy
2024-09-18 14:02:36 +00:00
John Colvin 2ac815949c Tweak DataGrid style in DataStream WebApp 2024-09-18 14:02:36 +00:00
John Colvin 046f451e76 Add AwsProd config for DataStream WebApp 2024-09-18 14:02:36 +00:00
John Colvin 36f191d49a fix: Add VITE_ prefix to imported env vars
For the DataStream WebApp client
2024-09-18 14:02:36 +00:00
John Colvin f55237029f Fix urls for DataStreamPublisher AwsProd.json 2024-09-18 14:02:36 +00:00
John Colvin 6fcf096924 Add benzinga news streams to AwsProd.json
This is a config profile for DataStreamPublisher, designed to be deployed
to aws (on public internet).
2024-09-18 14:02:36 +00:00
John Colvin 547383c8d9 fix build warnings: Make props nullable strings in SharedStreamConfig 2024-09-18 14:02:36 +00:00
Taha dc74b62304 Added benzinga streamd to MDPub's test config 2024-09-18 14:02:36 +00:00
Taha Afzal 8907681bb2 PubSubSingleTagState is not needed any more 2024-09-18 14:02:36 +00:00
Taha f16b921630 Icomplete SharedStreamsConfig was breaking build, fixing 2024-09-18 14:02:36 +00:00
Taha 614e9c69e1 Added new benzinga streams 2024-09-18 14:02:36 +00:00
John Colvin 5a59303dd4 whitespace: Format PubSubServer.json (indentation issues) 2024-09-18 14:02:36 +00:00
John Colvin d427538cd9 fix import from environment variable 2024-09-18 14:02:36 +00:00
John Colvin efaef11e7c fix add scripts to deploy data stream apps 2024-09-18 14:02:36 +00:00
John Colvin c095614c67 fix: Import websocket url from environment var 2024-09-18 14:02:36 +00:00
John Colvin 39c33f082f Add SpaServer to Production environment
For Bts.DataStreamWebApp.Server
2024-09-18 14:02:36 +00:00
John Colvin a3c0bc977e Change DirectoryBrowser requestPath to "/browse"
So we can view a psuedo file explorer for the webapp by requesting the "/browse" path
(only activated in Development environment).
2024-09-18 14:02:36 +00:00
John Colvin 9265746198 cleanup: Remove unused code in Bts.DataStreamWebApp.Client 2024-09-18 14:02:36 +00:00
John Colvin 0236e3a47a Capture OperationCanceledException (instead of TaskCanceledException)
The former is the base class for the latter, so this will widen the umbrella to catch a few corner cases
that would otherwise been handled by the generic "Exception" catch block. One corner case I know
of is when an op is canceled via "CancellationToken.ThrowIfCancellationRequested". In that case,
an OperationCanceledException is thrown (not a TaskCanceledException).

https://stackoverflow.com/questions/34359129/operationcanceledexception-vs-taskcanceledexception-when-task-is-canceled
2024-09-18 14:02:36 +00:00
John Colvin 71d52c2dc9 Hardcode webSocketUrl to aws server in DataStreamWebApp client 2024-09-18 14:02:36 +00:00
John Colvin ce0b4872ff Assert that System publishers 'doWork' is always called on same thread 2024-09-18 14:02:36 +00:00
John Colvin b686159cf3 fix: Make InternalPublisherQueue thread safe 2024-09-18 14:02:36 +00:00
John Colvin ee7c8c393e Improve error reporting in DataStreamWebSocketServer 2024-09-18 14:02:36 +00:00
John Colvin 7c4191289f data stream web app client check pt 2024-09-18 14:02:36 +00:00
John Colvin f18949a1e3 fix build: Fix Spark build after making config init async 2024-09-18 14:02:36 +00:00
John Colvin f3b9cb2d62 fix Change Configuration.initialize to be async 2024-09-18 14:02:36 +00:00
John Colvin faeb10cf9d refactor: Tweak SparkCoreServices to synchronize Configuration.init globally 2024-09-18 14:02:36 +00:00
John Colvin e5f1039671 refactor: Change Configuration.initialize to be async 2024-09-18 14:02:36 +00:00
John Colvin e93f970706 SparkApiService check pt 2024-09-18 14:02:36 +00:00
John Colvin 844677dae0 pubsub server checkpt 2024-09-18 14:02:36 +00:00