John Colvin
8421e4ae1a
Change PubSub scheme prefix from 'bluto' -> 'bts-cloud'
2024-07-01 23:36:04 -04:00
Taha
a8d0712e30
Added pubsub routes to the Title of DSQA
2024-07-01 23:36:04 -04:00
John Colvin
d26e653a6b
Tweak grid colors in DataStream web app
2024-07-01 11:23:46 -04:00
John Colvin
56e087ab8b
refactor: Move DataStreamWebApp themes to their own js file
2024-07-01 11:23:45 -04:00
Taha
c71bb8c301
Fixing the bug where messages were being sent by the pubsubserver out of order
2024-06-27 01:32:18 -04:00
John Colvin
44d6173ddf
feat: Add DataStream WebApp
...
Included in DataStreamSuite.sln, but not DataStreamQueryAnalyzer.sln
2024-06-26 14:33:04 -04:00
John Colvin
322152c743
build: Copy libspark to all dotnet dirs in single cmake target
...
This is cleaner than the previous impl, which used separate build
targets to copy libspark to "net7.0", and "net7.0-windows" (dirs).
Note: I decided to clean this up now because I'm about to upgrade the
new DataStream WebApp to net8.0, and did not want to add yet another
build target to copy libspark to "net8.0".
2024-06-26 14:33:04 -04:00
John Colvin
9ab39587e2
fix: Parse ServerAddress as normal string
...
The "JsonValueOrArrayConverter<T>" doesn't work the way I thought it
would. When it is associated with a property via the JsonConverter
attribute, dotnet json parsing code throws an exception if "T" isn't
assignable to the property type.
2024-06-26 14:33:04 -04:00
John Colvin
72f59924ea
fix build (api server): Change namespace to bts.websocket_core
2024-06-26 14:33:04 -04:00
John Colvin
3cf388f041
fix build (warn): Only use Registry on windows
2024-06-26 14:33:03 -04:00
John Colvin
3e401a766d
cleanup: Fix numerous build warnings in DataStreamSuite
...
Nearly all warnings were due to nullability issues, since the concept of
nullable reference types did not exist when the DataStream code was
originally written.
* PubSubClientMessage
- Normalize indentation/whitespace
- Fix some typos
- Address nullability issues to fix build warnings
- Modernize code
* Compression related files
- ZipEntry
- ZipFile
- ZipInputStream
- TarHeader
* RemoteMessage
- make 'message' nullable to resolve warnings elsewhere (in calling code)
* PubSubSingleTagStateEvent.cs
* PubSubMessageReactor
* PubSubState
* SystemHeartbeatPublisher
* SystemStatsPublisher
* SingleTagData
* ManagedTCPMessageHub
* PubsubDeserializationController
* PublisherCore
* InflaterHuffmanTree
* AsyncTCPConnection_APM
* ThreadSafeQueue
* ManagedSubscriber
* SubscriberCore
* PubSubServerManagedTCPConnection
* AsyncTCPConnection_APM
* SuperMapStream
* MapStream
* TradeBarsStream
2024-06-26 14:33:03 -04:00
John Colvin
b16ff50120
cleanup: Normalize indentation in TradeBarsStream
2024-06-26 14:33:03 -04:00
John Colvin
44564f7d56
cleanup: Disable nullability warnings
...
* BZip2InputStream
* TarInputStream
* Inflater
* InflaterDynHeader
* BZip2OutputStream
* DeflaterHuffman
* ParallelJoinTest
2024-06-26 14:33:03 -04:00
John Colvin
eaa5580e89
cleanup: Modernize PubSubRoute code, json parsing
2024-06-26 14:33:03 -04:00
John Colvin
5de4e31880
cleanup: Remove unused DateTime grammar from exp parser
2024-06-26 14:33:03 -04:00
John Colvin
7cf90d95da
Add JsonRpcRequestObservable, AsyncEnumerable
2024-06-26 14:33:03 -04:00
John Colvin
ec36d84412
Add json facilities for DataStream websocket api
2024-06-26 14:33:03 -04:00
John Colvin
95aad773a2
refactor: Add handy WebsocketExtensions
...
* IsSocketStateOpen
* IsClosedProperly
2024-06-26 14:33:03 -04:00
John Colvin
fb476de0a3
feat: Add JsonRpc types for websocket paradigm
2024-06-26 14:33:03 -04:00
John Colvin
41b42719ce
cleanup: Remove empty file (clearly added by accident)
2024-06-26 14:33:03 -04:00
John Colvin
c1f8aadd5d
fix: Fix improper 'OfType' linq cast
...
Previously, animations were expressed through polymorphism (derived from the
base class CellAnimation), but the new impl uses composition. This 'OfType' call
was leftover from the polymorphism implementation, an attempt to linq cast
elements of base class (CellAnimation) to BackgroundAnimation.
2024-06-26 14:33:03 -04:00
John Colvin
90ee45db30
refactor: Add WebsocketClient class
...
Basically an ISubject (I/O) wrapper for IWebsocketConnectionGateway
2024-06-26 14:33:03 -04:00
John Colvin
6dd701dd33
refactor: Change WebsocketServerConfig.port to uint32
...
It should always be a number between 1-65535
2024-06-26 14:33:03 -04:00
John Colvin
456c953839
refactor: Rename WebsocketServerConfig proto pkg 'bts.websocket_core'
...
This matches the namespace used in spark_websocket csproj. Eventually,
I'd like to use conventional capitalization (TitleCase namespaces/types,
etc.), but let's shelf that until we have enough time/energy to do a
more comprehensive refactoring.
2024-06-26 14:33:03 -04:00
John Colvin
492f02eb21
refactor: Remove nullability constraint in GetValueOrDefault
2024-06-26 14:33:03 -04:00
John Colvin
41d2fd9c51
refactor: Use events to avoid circular deps for ws sync/gateway
2024-06-26 14:33:03 -04:00
John Colvin
59f3c446ba
refactor: Let caller specify nullability of T in json parse fn
2024-06-26 14:33:03 -04:00
Taha
9aadda2429
some buf gixes + cleanup
2024-06-26 14:29:22 -04:00
Taha
57ac078469
PubSuMessageReactor empties the message queue (instead oif one elem ata a time) in the main loop
2024-06-26 14:28:52 -04:00
Taha
c39fc70a64
PubSubServer's linux issues fixed
2024-06-26 14:28:51 -04:00
Taha
5cf7eacd82
Fixing the extra .0 in the default pubsub server routeplusfixing acorner cae issue of gettign a fast streaming data cakback after an unsubscribe
2024-06-24 00:28:07 -04:00
John Colvin
5620f33524
vscode: Add task to view logs for last PubSubServer run
2024-06-08 14:42:13 +00:00
John Colvin
3b631e0d5f
Fix a couple more typos in logs
2024-06-07 16:35:06 +00:00
John Colvin
23d7d3775d
cleanup: Delete unused files
2024-06-07 10:40:34 -05:00
John Colvin
4940771166
fix: Don't login to sparkd from DSQA
2024-06-07 10:02:42 -05:00
John Colvin
8c797ee76b
Fix typo in log msg
2024-06-06 09:21:01 -05:00
John Colvin
ce80957d07
DSQA shouldn't connect to sparkd by default
2024-06-06 09:21:01 -05:00
John Colvin
c60018b59e
DataStreamPublisher shouldn't connect to sparkd by default
...
It only needs to connect to sparkd if it's publishing market data
2024-06-06 09:21:01 -05:00
John Colvin
3a27af87d1
PubSubServer shouldn't download config from sparkd by default
...
As far as I know, it only needs spark/protobuf config to initialize the
c++ logging system. Eventually, we should get rid of that dependency and
use builtin Microsoft Logging facilities for c# instead. In the
meantime, PubSubServer will load config from local files by default
(i.e., spark.conf).
2024-06-06 09:21:01 -05:00
John Colvin
068c1c6973
cleanup: Remove erroneous comment
2024-06-06 09:21:01 -05:00
John Colvin
4a2735839e
Change line endings to crlf in a few cs files
2024-06-06 09:21:00 -05:00
John Colvin
d2e9fe8237
Change line endings to crlf in a few cs files
2024-06-06 09:21:00 -05:00
John Colvin
cfc60766d8
Change line endings to crlf in a few cs files
2024-06-06 09:21:00 -05:00
John Colvin
b03fec7f79
Change line endings to crlf in a few cs files
2024-06-06 09:20:59 -05:00
John Colvin
e44601d1b1
fix merge: Bring back few fns that SchemaGuesserStream needs
...
* BlueDataUtility.get_typed_schema
* BlueDataUtility.get_typed_table
2024-06-06 09:20:05 -05:00
Taha
07bade53c0
Fixing AsyncTCPCOnnection_APM's double partial messages for messages > 100 MB
2024-06-06 09:20:05 -05:00
Taha
fac0a9c25b
RemoteQueryStream
2024-06-06 09:20:05 -05:00
John Colvin
45f02391d1
cleanup: Remove sparkd login creds from PubSubServerConfig
...
It only needs a Sparkd url to download logging config. TBH, we can probably
get rid of that too, and simply read the local spark.conf.
2024-06-06 09:15:17 -05:00
John Colvin
a3ca06addc
Reduce 'internal_publish' log level to Diag
...
It was a bit noisy for the Info level
2024-06-06 09:15:17 -05:00
John Colvin
32869e54ec
fix: Fix typos in c# Logs
...
Prefix a few msgs with '$' so vars in curly braces are expanded via
interpolation
2024-06-06 09:15:17 -05:00