contol-m
Joined 16 years ago
Karma
65
Submissions
32
Member since
Aug 5
Recent submissions
Comment · 3 years ago
Comment · 4 years ago
Currently the main benefit of BigLake over the current external tables is governance: you get row and column level security over cloud storage data. The governance is uniformly enforced across BigQuery and also the BigQuery storage API. The storage API can be used by any engine and we have pre-built open source connectors available for Spark, Presto/Trino, Dataflow and Tensorflow.
We're constantly working on improving BigQuery performance over open file formats on cloud storage. Some of these features will be specific to BigLake. Please stay tuned.
Comment · 4 years ago
I work on BigQuery. All of these are great points: just wanted to point out that BigQuery can federate into external data sources as well: e.g. files on cloud storage and BigTable. Relevant feature is BigLake: https://cloud.google.com/bigquery/docs/biglake-intro
Comment · 5 years ago
Former A9 employee here. A9 was not an acquisition - it was bootstrapped as a Bay Area subsidiary. Initially A9 focused on web search, then pivoted to doing product search for Amazon retail.
Comment · 6 years ago
Could you explain further?
Comment · 7 years ago
Lucene is a low level library which is internally used by ElasticSearch and Solr. Vespa is built from the ground up - it does not use Lucene.
Comment · 13 years ago
They should really dispatched to fix the Google Drive Client program for Mac. It consistently maxes out a CPU even when there is no sync going on. I can consistently reproduce this issue on all Macs I own.
BigQuery also supports in-place querying of datasets on GCS (or S3/Azure using Omni) via external/BigLake tables. https://cloud.google.com/bigquery/docs/query-cloud-storage-u...