Events ingested, but not shown.

[blaggacao]

Can you help me hint in the right direction?

In events_v2, I have:

[ ... ]
59 rows in set. Elapsed: 0.003 sec.

my.redacted.host :)

But the front-end keeps insisting:

Yet, also, somewhat more correctly:

[ruslandoga]

👋 @blaggacao

Please share more information on your setup, docker-compose.yml, plasuible-conf.env with secrets redacted, etc.

Also this thread might be helpful: #3725

[blaggacao]

TZDIR=/nix/store/i6nk8llh46f2xjzc5h8j83kwwr1w3kx0-tzdata-2024a/share/zoneinfo

[blaggacao]

Ah!

native_stats_start_at
2024-05-23 08:36:52

That seemed to have been correctly set. However, not correctly read.

[blaggacao]

Maybe due to this line:

analytics/lib/plausible/site/admin.ex

Line 27 in 5881f1c

{:ok, Ecto.Changeset.put_change(changeset, :stats_start_date, nil)}

🤷

[ruslandoga]

That seemed to have been correctly set. However, not correctly read.

Is it supposed to be 2024-05-23 08:36:52 UTC+5?
What would be the correct way and what would be the incorrect way to read it?

Maybe due to this line:

I don't think that line is relevant since CRM is disabled in the community edition.

---

My guess is it has something to do with non-UTC server timezone and this query

analytics/lib/plausible/stats/clickhouse.ex

Lines 16 to 20 in c81cb16

	from(e in "events_v2",
	select: fragment("min(?)", e.timestamp),
	where: e.site_id == ^site.id,
	where: e.timestamp >= ^site.native_stats_start_at
	)

which passes a "naive" (i.e. no tz info) sites.native_stats_start_at timestamp from PostgreSQL in a WHERE clause to ClickHouse. sites.native_stats_start_at is set to now() on site insert.

[blaggacao]

Is it supposed to be 2024-05-23 08:36:52 UTC+5?
What would be the correct way and what would be the incorrect way to read it?

Now I'm confused.

id |      domain      |     inserted_at     |     updated_at      |    timezone    | public | locked | has_stats | imported_data | stats_start_date | ingest_rate_limit_scale_seconds | ingest_rate_limit_threshold | native_stats_start_at | domain_changed_from | domain_changed_at | allowed_event_props
----+------------------+---------------------+---------------------+----------------+--------+--------+-----------+---------------+------------------+---------------------------------+-----------------------------+-----------------------+---------------------+-------------------+---------------------
  1 | shop.exmaple.co | 2024-05-23 07:30:27 | 2024-05-23 08:36:52 | America/Bogota | f      | f      | f         |               | 2024-03-05       |                              60 |                             | 2024-05-23 08:36:52   |                     |                   |

I'm trying to remeber when I started the site:

• It was after the morning routine, that is it must have been later than 0900 UTC+2
• So if these values are UTC, then that would translate to creation at 0730UTC or 0930UTC+2 and updated (I tried to "restet stats" to see if it would solve my initial problem) at 0836 or 1036UTC+2 ✔️ This is likely the case

So I conclude they are UTC values, indeed.

I'd have to learn elixir to be able to dig further, I guess 😄

I'm not sure if I'm being useful, here. Sry, if not.

[blaggacao]

Solved by #3725 (reply in thread)