John Colvin
a0029ed4c6
build: Use separate cmd to build DataStreamSuite/QueryAnalyzer.sln
...
The DataStreamSuite.sln builds the new webapp now, which will
(eventually) replace DSQA. We'll keep it around for now, but with a
clean separation from the main build.
2024-10-21 13:29:57 +00:00
John Colvin
add3aa8bd3
feat: Add DataStream WebApp
...
Included in DataStreamSuite.sln, but not DataStreamQueryAnalyzer.sln
2024-10-21 13:29:57 +00:00
John Colvin
6dbd77c6b5
Add spark service modules designed for Dependency Injection
2024-10-21 13:29:57 +00:00
John Colvin
83848f455d
build: Copy libspark to all dotnet dirs in single cmake target
...
This is cleaner than the previous impl, which used separate build
targets to copy libspark to "net7.0", and "net7.0-windows" (dirs).
2024-10-21 13:29:57 +00:00
John Colvin
6d5464bb92
fix: Parse ServerAddress as normal string
...
The "JsonValueOrArrayConverter<T>" doesn't work the way I thought it
would. When it is associated with a property via the JsonConverter
attribute, dotnet json parsing code throws an exception if "T" isn't
assignable to the property type.
2024-10-21 13:29:57 +00:00
John Colvin
3afe3f3928
fix build (api server): Change namespace to bts.websocket_core
2024-10-21 13:29:57 +00:00
John Colvin
9d71c90bef
Remove docker submodules again
2024-10-21 13:29:57 +00:00
John Colvin
9164ae470f
Change externals url from ssh to https style
...
So we don't need ssh keys to clone it (the builtin credential manager
makes https authentication safe/easy)
2024-10-21 13:29:57 +00:00
John Colvin
14c6d5f687
cleanup: Fix benign typos in build scripts
...
Change BUILD_SPARK_PY var name to BUILD_PY (because these scripts to actually build 'spark')
2024-10-21 13:29:57 +00:00
John Colvin
6c0f898c4a
fix build (warn): Only use Registry on windows
2024-10-21 13:29:57 +00:00
John Colvin
b210296056
cleanup: Fix numerous build warnings in DataStreamSuite
...
Nearly all warnings were due to nullability issues, since the concept of
nullable reference types did not exist when the DataStream code was
originally written.
* PubSubClientMessage
- Normalize indentation/whitespace
- Fix some typos
- Address nullability issues to fix build warnings
- Modernize code
* Compression related files
- ZipEntry
- ZipFile
- ZipInputStream
- TarHeader
* RemoteMessage
- make 'message' nullable to resolve warnings elsewhere (in calling code)
* PubSubSingleTagStateEvent.cs
* PubSubMessageReactor
* PubSubState
* SystemHeartbeatPublisher
* SystemStatsPublisher
* SingleTagData
* ManagedTCPMessageHub
* PubsubDeserializationController
* PublisherCore
* InflaterHuffmanTree
* AsyncTCPConnection_APM
* ThreadSafeQueue
* ManagedSubscriber
* SubscriberCore
* PubSubServerManagedTCPConnection
* AsyncTCPConnection_APM
* SuperMapStream
* MapStream
* TradeBarsStream
2024-10-21 13:29:57 +00:00
John Colvin
5b30cd05f9
cleanup: Normalize indentation in TradeBarsStream
2024-10-21 13:29:57 +00:00
John Colvin
8dabbb6122
cleanup: Disable nullability warnings
...
* BZip2InputStream
* TarInputStream
* Inflater
* InflaterDynHeader
* BZip2OutputStream
* DeflaterHuffman
* ParallelJoinTest
2024-10-21 13:29:57 +00:00
John Colvin
7526f91178
cleanup: Modernize PubSubRoute code, json parsing
2024-10-21 13:29:57 +00:00
John Colvin
ca10c3cc15
cleanup: Remove unused DateTime grammar from exp parser
2024-10-21 13:29:57 +00:00
John Colvin
04ce62cce1
Add JsonRpcRequestObservable, AsyncEnumerable
2024-10-21 13:29:57 +00:00
John Colvin
5bfe82da72
Add json facilities for DataStream websocket api
2024-10-21 13:29:57 +00:00
John Colvin
6f556bbab4
refactor: Add handy WebsocketExtensions
...
* IsSocketStateOpen
* IsClosedProperly
2024-10-21 13:29:57 +00:00
John Colvin
bac4d3e780
feat: Add JsonRpc types for websocket paradigm
2024-10-21 13:29:57 +00:00
John Colvin
f5c100a604
cleanup: Remove empty file (clearly added by accident)
2024-10-21 13:29:57 +00:00
John Colvin
fafe91bc7b
fix: Fix improper 'OfType' linq cast
...
Previously, animations were expressed through polymorphism (derived from the
base class CellAnimation), but the new impl uses composition. This 'OfType' call
was leftover from the polymorphism implementation, an attempt to linq cast
elements of base class (CellAnimation) to BackgroundAnimation.
2024-10-21 13:29:57 +00:00
John Colvin
9350617698
editorconfig: Use standard c# capitalization rules
...
* Use 'PascalCase' for public members (instead of 'snake_case')
* Use 'camelCase' for private members (instead of '_snake_case')
2024-10-21 13:29:57 +00:00
John Colvin
4efe5ee543
refactor: Add WebsocketClient class
...
Basically an ISubject (I/O) wrapper for IWebsocketConnectionGateway
2024-10-21 13:29:57 +00:00
John Colvin
a29956023a
refactor: Change WebsocketServerConfig.port to uint32
...
It should always be a number between 1-65535
2024-10-21 13:29:57 +00:00
John Colvin
bcc3971487
refactor: Rename WebsocketServerConfig proto pkg 'bts.websocket_core'
...
This matches the namespace used in spark_websocket csproj. Eventually,
I'd like to use conventional capitalization (TitleCase namespaces/types,
etc.), but let's shelf that until we have enough time/energy to do a
more comprehensive refactoring.
2024-10-21 13:29:57 +00:00
John Colvin
3307699ee7
refactor: Remove nullability constraint in GetValueOrDefault
2024-10-21 13:29:57 +00:00
John Colvin
4dd8772aa6
refactor: Use events to avoid circular deps for ws sync/gateway
2024-10-21 13:29:57 +00:00
Mohammad Arham
36b6168dec
Taifex State working
2024-10-18 21:13:56 +00:00
John Colvin
e4c87c267d
Fix DateTimeConstant token regex for DataStreams
...
The previous regex was overly ambitious (and needlessly complex as a
result). The new regex is simpler, and doesn't impose bounds on month
and day ints, aside from requiring 1-2 digits.
Bugs (fixed):
* The DataStreamExpressionInterpretter fails to parse certain date
constants, such as "8/30/2024"
2024-10-15 11:46:58 -04:00
Mohammad Arham
86899a6ff0
FIX: TAifex state working
2024-10-14 17:19:03 +00:00
Adeel Khan
2324fd3ad2
CHANGE: Taifex State Mgmt
2024-10-14 20:59:34 +05:00
Mohammad Arham
8850bf4903
Remove: Assert in taifex code
2024-10-09 14:53:20 +00:00
Mohammad Arham
11112b41d1
Add: Missing config entry databento
2024-10-09 02:36:35 +00:00
Adeel Khan
2a98889b67
UPDATE: TaifexDataGateway
2024-10-09 02:18:28 +00:00
Adeel Khan
8060518a28
FIX: Removed Taifex Bugs
2024-10-08 21:29:44 +00:00
Mohammad Arham
68440d3df3
ADD: Config for one year security filter
2024-10-08 13:50:38 +00:00
Mohammad Arham
7d775afc4c
Add: Taifex after hours ip change config
2024-10-08 13:49:36 +00:00
Mohammad Arham
50c7764ef7
Add: Databento security filter
2024-10-07 20:33:38 +00:00
Mohammad Arham
fb8b2d28f3
Fix: DATABENTO live working
2024-10-07 20:05:38 +00:00
Mohammad Arham
bcc2c4a514
CHANGE: Taifex Refactored
2024-10-07 16:26:12 +00:00
Mohammad Arham
9352298be0
Add: Taifex statehandler
2024-10-07 08:51:55 +00:00
Mohammad Arham
180bd11740
FIX: Taifex replay types of files handled
2024-10-06 21:31:34 +00:00
Mohammad Arham
57ea841381
ADD: i084 taifex
2024-10-06 20:31:07 +00:00
Mohammad Arham
7d9d176fa2
Change: Rename taifex files
2024-10-06 18:38:36 +00:00
Mohammad Arham
a8f4ec07c8
Change: moved file paths to config for taifex file replay
2024-10-06 08:29:27 +00:00
Mohammad Arham
58c5be268f
Add: Refactored taifex code to break it down
2024-10-06 08:01:22 +00:00
Mohammad Arham
bf4859a2a9
Change: Refactored read binary file taifex
2024-10-06 07:28:12 +00:00
Adeel Khan
db1cf93994
Add: Incremental Books
2024-10-04 23:23:54 +05:00
Adeel Khan
ecb1c4fea0
Add: Taifex Trades
2024-10-04 23:23:41 +05:00
Mohammad Arham
a513933044
Add: Exceptions handling for databento
2024-10-04 13:06:56 +00:00