Recent submissions

Comment · 3 years ago
Comment · 3 years ago
Maybe you can check:

  - https://github.com/turbot/steampipe (which will query the sources on demand): Use SQL to instantly query your cloud services (AWS, Azure, GCP and more). Open source CLI. No DB required.

  - https://github.com/cloudquery/cloudquery (which will retrieve data in batch, and save them into another database for query)
Comment · 4 years ago
Comment · 4 years ago
Already switched to fly.io. It is also great, and its VM will not "sleeping while inactive"
Comment · 4 years ago
The document for pocketbase's realtime is: https://pocketbase.io/docs/api-realtime/

The Realtime API is implemented via Server-Sent Events (SSE). Generally, it consists of 2 operations:

  * establish SSE connection

  * set client subscriptions
SSE events are sent for create, update and delete record operations.

Pocketbase is mainly a single application with SQLite embedded, so, whenever you update records through PocketBase's API, the main application always knows that.

This is different with postgres, since it may be connected by several different applications/servers remotely.

Comment · 4 years ago
It is very hard to develop on premise product.

First you need to works with different Linux OS (ubuntu, redhat, etc.), and nowadays, product may contain a lot of microservice, then you need a kubernetes cluster, which is very hard to maintain. And then, you need to find a good storage (object/blob storage) for kubernetes.

Then, you may need to often troubleshooting server issues (like, disk full, slow disk issue, out of memory, kubernetes network broken). And you need to often check whether the data backup system works.

It is much easier to operate as SaaS, and you can pick your OS and your machine spec, and your programing stacks

Comment · 4 years ago
pocketbase is great, I used it in several personal projects, and I really like it

https://github.com/pocketbase/pocketbase

PocketBase is an open source Go backend, consisting of:

  * embedded database (SQLite) with realtime subscriptions

  * built-in files and users management

  *convenient Admin dashboard UI

  *and simple REST-ish API
Comment · 4 years ago
Scala was fun when my company was small.

Later, we need to recruit more people, it became harder and harder. Each need to learn a lot before they can contribute bug fix to product. They need to learn:

  - Scala

  - Akka

  - very basic of sbt (if they need to change more than basic usage, they come to me for that change, as I'm the only one who learned complex sbt syntax in our team currently)

  - Play framework

  - Slick

But now, several years later, Akka's license change really make us to consider switch back to plain Java and Maven one part by another. For the actor model, I really like it, it can simplify Synchronization A lot, we researched Vert.X, which seems can do most of Akka (Although I haven't research whether Akka Clustering, persistent can work similar in Vert.X yet).
Comment · 4 years ago
I planned to write a series of articles about how to build distributed applications on Akka Clustering, now, there's no need for that. I wish I didn't recommend Akka to my friends. Thanks.
Comment · 4 years ago
I would also suggest prql, which is also great. Plus: - the license of prql is better (APACHE v2 vs GPL v2) - although having modeling layer is good, but something like dbt-metrics maybe better. In this point, prql is more focus, on querying part.
Comment · 4 years ago
you may check: https://github.com/jitsucom/jitsu. "Jitsu is an open-source Segment alternative. Fully-scriptable data ingestion engine for modern data teams. Set-up a real-time data pipeline in minutes, not days"

You can create an API endpoint, and send those JSON to it. In the "destination" part, it can sync to clickhouse (one of many choices, like redshift, snowflake,besides clickhouse) very quickly, and flatten the JSON into columns. If there is new key found in JSON, it will create a new column in clickhouse.

Comment · 4 years ago
Noticed this is answered in: https://github.com/apache/logging-log4j2/pull/608#issuecomme...

``` I believe that applications that use log4j-api with log4j-to-slf4j, without using log4j-core, are not impacted by this vulnerability. (Because the lookup and JNDI implementations are in log4j-core.)

```

Comment · 4 years ago
OK, thanks, didn't notice this when I read it.
Comment · 4 years ago
Do anyone know if I depends on the following 2: - org.apache.logging.log4j:log4j-api - org.apache.logging.log4j:log4j-to-slf4j

But without dependency on - org.apache.logging.log4j:log4j-core

in this situation, is this safe from this RCE? Thanks.

Edit, This may affect both log4j 2.x and log4j 1.x (see comments bellow, thanks.)

Live from the official Hacker News API

A modern reader for Hacker News · SvelteKit + Skeleton