Skip to content

DS ADR: Clocks and Kafka timestamping - #273

Merged
rerpha merged 4 commits into
masterfrom
ds_clocks
Nov 4, 2026
Merged

rerpha merged 4 commits into
masterfrom
ds_clocks

Conversation

@Tom-Willemsen

Copy link
Copy Markdown
Member

Kind of part of ISISComputingGroup/DataStreaming#119, but also a bit more general...

@Tom-Willemsen
Tom-Willemsen requested a review from rerpha October 11, 2026 18:28

None of the above clocks are guaranteed to be monotonic; NTP may correct time backwards, and GPS time may jump backwards
under foreseeable failure conditions.

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Can we make use of PTP either across the board of instead of NTP. The accelerator whiterabbit syncs to GPS i believe, if everything could sync to PTP the they are all syncing to the same time source?

Copy link
Copy Markdown
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Added a sentence about how this might happen in future.

I think pragmatically this is unlikely to happen in time for HRPD-X (we're already a bit squeezed on time) though.

May also need consideration for things like MNeuData in future (if that ends up happening...)

### Run starts / stops

Run starts and stops will be modified to contain **both** a local timestamp according to the streaming server, and a
GPS timestamp according to the streaming control board. This will require changes to the SCB firmware and

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

it will also require changes to the schemas, which currently only have one start time / stop time field.

Copy link
Copy Markdown
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Yep ISISComputingGroup/streaming-data-types#19 if this ADR is accepted.

…tes using perf counter periodically synced to system time.
@rerpha
rerpha merged commit add6aca into master Nov 4, 2026
2 checks passed
@rerpha
rerpha deleted the ds_clocks branch November 4, 2026 14:57
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants