John Colvin
25c42e388f
refactor: Decouple ViewPublisher from IPubTableBroker impl
2024-10-30 19:31:08 +00:00
John Colvin
3187722159
Add PubSub service modules designed for Dependency Injection
...
* Get rid of JsonPropertyName attributes in PubSubConfig
- The Dependency Injection framework (based around dotnet ApplicationBuilder)
does not support this attribute, and maps property names verbatim to json fields.
* Change PubSubServer json fields to match cs class property names verbatim
2024-10-30 19:31:08 +00:00
John Colvin
352cb97818
refactor: Decouple RemoteQueryManager from IManagedSubscriber, IPubTableBroker impl
2024-10-30 19:30:30 +00:00
John Colvin
0215b7990e
refactor: Decouple ManagedSubscriber from ISubscriberCore impl
2024-10-30 19:30:30 +00:00
John Colvin
1644b5b58b
refactor: Only support 1 tag type in IPubSubServerTagHandler
2024-10-30 19:30:30 +00:00
John Colvin
b2ea6820d7
refactor: Decouple PubTableBroker from IPublisherCore impl
...
Reference interface rather than the PublisherCore impl.
2024-10-30 19:30:30 +00:00
John Colvin
5c9fc5ccc2
improvement: Accept CancellationToken in JsonRpcRequestObservable
2024-10-30 19:30:30 +00:00
John Colvin
4bd6f149b9
fix: Dispose market data sub in various md streams
2024-10-30 19:30:30 +00:00
John Colvin
293f7f3833
cleanup: Remove unused pubsub tag handler code
...
* Removed 'IPubSubServerTagHandler.register'
- All implementations of this function were empty
* Removed 'IPubSubServerTagHandler.supportedTagTypes'
- This property wasn't referenced anywhere
* Remove IWorker inheritance from IPubSubServerTagHandler
- No reason these interfaces have to be tied together
2024-10-30 19:30:30 +00:00
John Colvin
ad2f9a8624
refactor: Rename CloudStreamManager.cs -> RemoteQueryManager.cs
...
This matches the file name
2024-10-30 19:30:30 +00:00
John Colvin
99922725e1
Change pub sub schema prefix 'bluto://' -> 'bts-cloud://'
...
In config json files (not actual code change)
2024-10-30 19:30:30 +00:00
John Colvin
60c3cc0015
fix build: Fix prop names after refactoring PubSubRoute
...
* Change 'server_address' -> 'ServerAddress'
* Change 'tag_reg_exp' -> 'TagRegExp'
2024-10-30 19:30:30 +00:00
John Colvin
775567968b
build: Add scripts to publish data stream apps
2024-10-30 19:30:30 +00:00
John Colvin
e1555387ec
Fix typo in log msg
2024-10-30 19:30:30 +00:00
John Colvin
d044f711a3
Fix build scripts so they propagate the exit code back to the shell
...
I noticed this was broken because launch.json configurations would still start the debugger
even when the preLaunchTask (build) failed!
2024-10-30 19:30:30 +00:00
John Colvin
eba801845c
vscode: Add DataStreamPublisher debug cfg to skip build
2024-10-30 19:30:30 +00:00
John Colvin
04f85818c6
build: Use separate cmd to build DataStreamSuite/QueryAnalyzer.sln
...
The DataStreamSuite.sln builds the new webapp now, which will
(eventually) replace DSQA. We'll keep it around for now, but with a
clean separation from the main build.
2024-10-30 19:30:29 +00:00
John Colvin
545dcdf9ff
feat: Add DataStream WebApp
...
Included in DataStreamSuite.sln, but not DataStreamQueryAnalyzer.sln
2024-10-30 19:30:29 +00:00
John Colvin
8c2d643e0c
Add spark service modules designed for Dependency Injection
2024-10-30 19:30:29 +00:00
John Colvin
ae70f731b7
build: Copy libspark to all dotnet dirs in single cmake target
...
This is cleaner than the previous impl, which used separate build
targets to copy libspark to "net7.0", and "net7.0-windows" (dirs).
2024-10-30 19:30:29 +00:00
John Colvin
828b06d4e2
fix: Parse ServerAddress as normal string
...
The "JsonValueOrArrayConverter<T>" doesn't work the way I thought it
would. When it is associated with a property via the JsonConverter
attribute, dotnet json parsing code throws an exception if "T" isn't
assignable to the property type.
2024-10-30 19:30:29 +00:00
John Colvin
6fa8de176c
fix build (api server): Change namespace to bts.websocket_core
2024-10-30 19:30:29 +00:00
John Colvin
fec918aefd
Remove docker submodules again
2024-10-30 19:30:29 +00:00
John Colvin
aa57b3bb8c
Change externals url from ssh to https style
...
So we don't need ssh keys to clone it (the builtin credential manager
makes https authentication safe/easy)
2024-10-30 19:30:29 +00:00
John Colvin
ab206ccf87
cleanup: Fix benign typos in build scripts
...
Change BUILD_SPARK_PY var name to BUILD_PY (because these scripts to actually build 'spark')
2024-10-30 19:30:29 +00:00
John Colvin
06ad7c51be
fix build (warn): Only use Registry on windows
2024-10-30 19:30:29 +00:00
John Colvin
60a52b3922
cleanup: Fix numerous build warnings in DataStreamSuite
...
Nearly all warnings were due to nullability issues, since the concept of
nullable reference types did not exist when the DataStream code was
originally written.
* PubSubClientMessage
- Normalize indentation/whitespace
- Fix some typos
- Address nullability issues to fix build warnings
- Modernize code
* Compression related files
- ZipEntry
- ZipFile
- ZipInputStream
- TarHeader
* RemoteMessage
- make 'message' nullable to resolve warnings elsewhere (in calling code)
* PubSubSingleTagStateEvent.cs
* PubSubMessageReactor
* PubSubState
* SystemHeartbeatPublisher
* SystemStatsPublisher
* SingleTagData
* ManagedTCPMessageHub
* PubsubDeserializationController
* PublisherCore
* InflaterHuffmanTree
* AsyncTCPConnection_APM
* ThreadSafeQueue
* ManagedSubscriber
* SubscriberCore
* PubSubServerManagedTCPConnection
* AsyncTCPConnection_APM
* SuperMapStream
* MapStream
* TradeBarsStream
2024-10-30 19:30:29 +00:00
John Colvin
5426ba0aa7
cleanup: Disable nullability warnings
...
* BZip2InputStream
* TarInputStream
* Inflater
* InflaterDynHeader
* BZip2OutputStream
* DeflaterHuffman
* ParallelJoinTest
2024-10-30 19:24:18 +00:00
John Colvin
b1fdee5a22
cleanup: Modernize PubSubRoute code, json parsing
2024-10-30 19:24:18 +00:00
John Colvin
59461aadff
cleanup: Remove unused DateTime grammar from exp parser
2024-10-30 19:24:18 +00:00
John Colvin
2d3a9a77ae
Add JsonRpcRequestObservable, AsyncEnumerable
2024-10-30 19:24:18 +00:00
John Colvin
868b43ef8b
Add json facilities for DataStream websocket api
2024-10-30 19:24:18 +00:00
John Colvin
fc7043f6e1
refactor: Add handy WebsocketExtensions
...
* IsSocketStateOpen
* IsClosedProperly
2024-10-30 19:24:18 +00:00
John Colvin
7bec823545
feat: Add JsonRpc types for websocket paradigm
2024-10-30 19:24:18 +00:00
John Colvin
57c7868a24
cleanup: Remove empty file (clearly added by accident)
2024-10-30 19:24:18 +00:00
John Colvin
0b0ff8f502
fix: Fix improper 'OfType' linq cast
...
Previously, animations were expressed through polymorphism (derived from the
base class CellAnimation), but the new impl uses composition. This 'OfType' call
was leftover from the polymorphism implementation, an attempt to linq cast
elements of base class (CellAnimation) to BackgroundAnimation.
2024-10-30 19:24:18 +00:00
John Colvin
c9a8325713
editorconfig: Use standard c# capitalization rules
...
* Use 'PascalCase' for public members (instead of 'snake_case')
* Use 'camelCase' for private members (instead of '_snake_case')
2024-10-30 19:24:18 +00:00
John Colvin
d7e4c68c70
refactor: Add WebsocketClient class
...
Basically an ISubject (I/O) wrapper for IWebsocketConnectionGateway
2024-10-30 19:24:18 +00:00
John Colvin
70f782bc79
refactor: Change WebsocketServerConfig.port to uint32
...
It should always be a number between 1-65535
2024-10-30 19:24:18 +00:00
John Colvin
7e142860a3
refactor: Rename WebsocketServerConfig proto pkg 'bts.websocket_core'
...
This matches the namespace used in spark_websocket csproj. Eventually,
I'd like to use conventional capitalization (TitleCase namespaces/types,
etc.), but let's shelf that until we have enough time/energy to do a
more comprehensive refactoring.
2024-10-30 19:24:18 +00:00
John Colvin
1956e3a804
refactor: Remove nullability constraint in GetValueOrDefault
2024-10-30 19:24:18 +00:00
John Colvin
65b50eda3a
refactor: Use events to avoid circular deps for ws sync/gateway
2024-10-30 19:24:18 +00:00
Taha
83b37c6661
Merge branch 'development' of bitbucket.org:bluetradesys/spark into development
2024-10-30 13:36:33 -04:00
Taha
6163887cd3
Bunch of CME queries are now working
2024-10-30 13:36:23 -04:00
Mohammad Arham
214641aa1e
Add: cpp tp sec_common
2024-10-25 07:02:46 +00:00
Mohammad Arham
06bc7af232
FIx: Taifex md working
2024-10-25 06:59:52 +00:00
Mohammad Arham
36b6168dec
Taifex State working
2024-10-18 21:13:56 +00:00
Taha
f9aa9dd982
Merge branch 'development' of bitbucket.org:bluetradesys/spark into development
2024-10-15 23:48:34 -04:00
Taha
22f1ab44f9
Basic set of streams that can talks ot the LLM and get DSL back from few-shot prompt
2024-10-15 23:38:49 -04:00
John Colvin
e4c87c267d
Fix DateTimeConstant token regex for DataStreams
...
The previous regex was overly ambitious (and needlessly complex as a
result). The new regex is simpler, and doesn't impose bounds on month
and day ints, aside from requiring 1-2 digits.
Bugs (fixed):
* The DataStreamExpressionInterpretter fails to parse certain date
constants, such as "8/30/2024"
2024-10-15 11:46:58 -04:00